-- Logs begin at Fri 2021-08-27 00:41:25 UTC, end at Fri 2021-08-27 01:51:37 UTC. -- Aug 27 01:21:46.705989 dv-cinder-759169-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 27 01:21:46.717904 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 27 01:21:46.717904 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 27 01:21:46 2021] *** Aug 27 01:21:46.717904 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 01:21:46.717904 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 01:21:46.717904 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: nodename: dv-cinder-759169-3-iscsi Aug 27 01:21:46.717904 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: machine: x86_64 Aug 27 01:21:46.717904 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: clock source: unix Aug 27 01:21:46.717904 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: pcre jit disabled Aug 27 01:21:46.717904 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: detected number of CPU cores: 4 Aug 27 01:21:46.717904 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: current working directory: / Aug 27 01:21:46.717904 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: detected binary path: /usr/bin/uwsgi-core Aug 27 01:21:46.717904 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: your processes number limit is 47680 Aug 27 01:21:46.717904 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: your memory page size is 4096 bytes Aug 27 01:21:46.717904 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: detected max file descriptor number: 2048 Aug 27 01:21:46.717904 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: lock engine: pthread robust mutexes Aug 27 01:21:46.717904 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: thunder lock: enabled Aug 27 01:21:46.717904 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 27 01:21:46.717904 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 27 01:21:46.760990 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: Python main interpreter initialized at 0x55f76ab329c0 Aug 27 01:21:46.760990 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: python threads support enabled Aug 27 01:21:46.760990 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: your server socket listen backlog is limited to 100 connections Aug 27 01:21:46.760990 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: your mercy for graceful operations on workers is 90 seconds Aug 27 01:21:46.761333 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 01:21:46.761408 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: *** Operational MODE: preforking *** Aug 27 01:21:46.761658 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: *** uWSGI is running in multiple interpreter mode *** Aug 27 01:21:46.761658 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: spawned uWSGI master process (pid: 93621) Aug 27 01:21:46.761846 dv-cinder-759169-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 27 01:21:46.763212 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: spawned uWSGI worker 1 (pid: 93622, cores: 1) Aug 27 01:21:46.763212 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: spawned uWSGI worker 2 (pid: 93623, cores: 1) Aug 27 01:21:46.763212 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 01:21:48.438428 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 01:21:48.438428 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: from cryptography.utils import int_from_bytes Aug 27 01:21:48.439126 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 01:21:48.439126 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: from cryptography.utils import int_from_bytes Aug 27 01:21:48.439417 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 01:21:48.439417 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: from cryptography.utils import int_from_bytes Aug 27 01:21:48.439976 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 01:21:48.439976 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: from cryptography.utils import int_from_bytes Aug 27 01:21:51.143682 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 01:21:51.144386 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 01:21:51.144574 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 01:21:51.144574 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 01:21:51.145127 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 01:21:51.145363 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 01:21:51.145456 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 01:21:51.145456 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 01:21:51.145618 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 01:21:51.145618 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 01:21:51.145756 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.145756 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.145907 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.146015 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.146160 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.146336 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.146431 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.146668 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.146763 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.146976 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.147063 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.147292 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.147382 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.147609 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.147699 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.147929 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.148011 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.148185 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.148275 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.148501 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.148595 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.148820 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.148923 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-759169-3-iscsi {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.149163 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.149246 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-759169-3-iscsi {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.149473 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.149566 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.149778 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.149861 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.150088 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.150169 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.150390 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.150474 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.150692 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.150781 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.151005 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.151086 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.151315 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.151504 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.151822 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.151934 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.152134 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.152239 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.152440 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.152537 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.152748 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.152994 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.153790 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.154476 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.154690 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.154926 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.155135 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.155249 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.155578 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.155578 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.155965 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.156190 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.156190 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.156576 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.156576 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.157047 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-759169-3-iscsi {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.157047 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.157429 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-759169-3-iscsi {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.157636 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.157857 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.158062 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.158271 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.158271 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.158525 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.158525 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.158776 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.158859 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.158937 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.159156 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.159243 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.159310 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.159374 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.159451 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.159518 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.159518 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.159632 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.159632 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.159948 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.160029 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.160102 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.160102 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.160225 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.160404 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.160551 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.160695 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.160856 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.161001 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.161181 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.161320 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.161472 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.161616 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.161752 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.161889 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.162034 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.162170 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.162319 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.162457 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.162591 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.162727 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.162871 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.163007 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.163152 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.163298 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.163442 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.163590 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.163804 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.163959 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.164098 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.164098 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.164373 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.164524 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.164680 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.164819 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.164999 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.165136 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.165291 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.165440 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.165586 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.165724 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.165861 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.165998 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.166134 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.166269 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.166418 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.166555 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.166691 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.166833 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.166980 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.167132 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.167287 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.167425 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.167562 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.167698 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.167834 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.167982 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.168120 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.168257 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.168399 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.168535 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.168671 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.169643 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.169819 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.169819 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.170115 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.170115 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.170378 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.170590 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.170732 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.170868 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.171000 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.171132 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.171272 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.171414 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.171552 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.171704 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.171845 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.171984 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.172129 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.172263 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.172404 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.172546 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.172686 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.172818 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.172997 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.173130 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.173263 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.173395 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.173539 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.173671 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.173812 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.173945 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.174076 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.174208 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.174349 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.174511 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.174661 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.174817 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.174956 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.175124 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.175274 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.175418 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.175559 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.175720 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.175868 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.176023 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.176161 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.176328 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.176476 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.176631 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.176775 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.176953 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.177087 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.177250 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.177402 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.177536 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.177674 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.177843 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.177984 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.178127 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.178264 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.178428 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.178576 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.178746 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.178887 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.179054 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.179193 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.179358 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.179497 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.179663 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.179815 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.179957 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.180088 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.180255 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.180409 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.180549 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.180690 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.180854 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.180995 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.181179 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.181337 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.181472 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.181603 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.181766 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.181907 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.182078 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.182222 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.182381 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.182520 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.182685 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.182827 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.182988 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.183133 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.183277 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.183409 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.183579 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.183721 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.183888 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.184027 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.184192 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.184430 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.184573 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.184707 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.184908 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.185059 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.185192 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.185344 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.185484 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.185618 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.185756 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.185890 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.186030 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.186172 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.186305 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.186444 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.186577 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.186708 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.186840 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.186995 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.187156 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.187297 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.187464 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.187604 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.187769 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.187916 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.188072 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.188212 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.188385 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.188525 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.188706 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:21:51.188879 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.189062 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.189213 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.189399 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.189539 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.189714 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.189854 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.190048 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.190199 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.190381 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.190521 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.190701 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.190841 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.191018 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.191170 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.191331 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.191478 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.191646 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.191786 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.191957 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.192102 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.192270 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.192423 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.192580 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.192718 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.192921 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.193072 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.193205 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.193351 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.193524 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.193665 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.193892 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.194036 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.194170 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.194312 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.194445 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.194578 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.194756 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.194897 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.195321 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.195470 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.195640 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.195787 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.195960 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.196099 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.196273 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.196732 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.196732 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.197022 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.197155 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.197288 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.197436 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.197607 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.197753 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.197894 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.198028 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.198167 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.198309 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.198442 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.198574 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.198713 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.198846 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.198986 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.199127 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.199261 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.199402 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.199536 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.199675 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.199808 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.200493 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.200644 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.200779 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.200947 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.201144 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.201286 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.201464 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.201606 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.201780 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.201921 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.202089 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.202242 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.202397 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.202537 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.202704 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.202845 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.203016 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.203164 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.203323 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.203464 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.203644 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.203797 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.203971 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.204120 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.204285 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.204426 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.204605 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.204745 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.204934 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.205088 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.205246 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.205392 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.205556 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.205696 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.205852 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.205986 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.206156 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.206298 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.206467 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.206606 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.206771 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.206912 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.207094 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.207235 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.207399 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.207544 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.207689 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.207837 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.208013 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.208153 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.208318 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.208459 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.208623 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.208763 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.208957 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.209099 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.209266 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.209406 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.209578 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.209724 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.209875 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.210007 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.210203 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.210338 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.210512 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.210615 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.210820 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.210908 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.211152 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.211250 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.211461 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.211548 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.211774 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.211867 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.212101 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.212200 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.212419 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.212504 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.212728 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.212813 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.213054 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.213162 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.213363 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.213449 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.213669 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.213768 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.213972 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.214058 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.214274 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.214366 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.214580 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.214665 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.214880 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.214965 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.215184 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.215269 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.215487 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.216169 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.216340 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.216493 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.216628 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.216793 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.216964 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.217143 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.217292 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.217455 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.217595 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.217765 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.217905 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.218076 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.218224 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.218423 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.218565 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.218732 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.218873 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.219078 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.219219 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.219412 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.219559 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.219731 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.219871 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.220054 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.220195 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.220366 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.220516 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.220710 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.220868 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.221090 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.221227 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.221359 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.221491 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.221633 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.221765 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.221906 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.222039 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.222200 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.222340 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.222512 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.222653 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.222834 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.222982 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.223146 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.223287 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.223471 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.223619 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.223782 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.223921 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.224105 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.224244 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.224409 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.224565 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.224724 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.224912 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.225091 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.225240 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.225425 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.225572 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.225745 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.225894 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.226070 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.226216 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.226383 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.226536 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.226685 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.226824 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.226992 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.227133 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.227306 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.227456 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.227597 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.227743 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.227901 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.228042 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.228215 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.228362 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.228526 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.228690 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.228869 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.229016 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.229171 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.229376 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.229524 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.229784 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.229979 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.230127 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.230401 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.230718 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.231049 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.231414 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.231604 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.231753 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.232057 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.232204 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.232382 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.232535 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.232712 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.232877 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.233061 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.233211 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.233380 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.233527 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.233697 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.233851 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.233991 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.234129 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.234301 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.234455 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.234618 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.234773 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.234921 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.235061 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.235227 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.235373 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.235519 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.235684 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.235825 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.235970 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.236137 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.236285 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.236446 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.236600 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.236747 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.236924 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.237071 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.237210 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.237360 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.237501 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.237680 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.237838 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.237978 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.238116 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.238262 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.238403 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.238575 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.238728 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.238901 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.239054 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.239202 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.239341 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.239523 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.239688 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.239863 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.240007 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.240158 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.240298 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.240445 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.240585 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.240723 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.240893 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.241048 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.241196 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.241336 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.241474 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.241631 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.241783 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.241924 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.242064 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.242261 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.242407 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.242574 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.242728 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.242869 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.243007 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.243184 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.243330 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.243494 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.243659 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.243806 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.243945 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.244105 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.244251 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.244422 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.244576 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.244740 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.244905 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.245061 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.245208 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.245348 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.245495 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.245645 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.245786 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.245969 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.246121 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.246269 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.246415 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.246576 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.246728 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.246931 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.247074 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.247319 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.247618 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.247779 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.247919 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.248059 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.248208 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.248357 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.248519 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.248665 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.248872 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.249025 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.249164 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.249318 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.249555 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.249723 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.249885 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.250065 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.250224 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.250388 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.250535 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.250713 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.250861 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.251039 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.251256 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.251406 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.251546 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.251696 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.251836 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.251986 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.252135 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.252303 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.252458 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.252598 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.252737 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.252932 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.253094 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.253234 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.253372 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.253537 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.253692 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.253844 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.253999 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.254148 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.254286 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.254424 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.254562 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.254717 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.254859 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.255025 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.255173 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.255320 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.255468 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.255640 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.255794 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.255945 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.256091 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.256239 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.256387 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.256536 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.256675 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.256814 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.257033 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.257174 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.257315 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.257460 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.257600 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.257760 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.257901 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.258039 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.258178 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.258324 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.258475 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.258627 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.258775 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.258915 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.259053 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.259191 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.259332 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.259483 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.259633 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.259823 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.259970 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.260154 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.260301 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.260498 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.260646 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.260791 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.260962 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.261141 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.261298 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.261469 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.261615 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.261771 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.261918 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.262058 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.262205 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.262352 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.263045 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.263287 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.263428 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.263568 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.263716 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.263863 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.264003 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.264143 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.264293 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.264432 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.264581 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.264720 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.264921 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.265071 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.265210 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.265348 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.265498 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.265706 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.265851 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.265990 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.266129 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.266287 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.266428 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.266567 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.266706 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.266845 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.266983 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.267135 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.267282 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.267428 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.267575 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.267716 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.267855 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.268011 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.268151 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.268291 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.268431 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.268576 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.268716 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.268890 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.269051 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.269196 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.269336 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.269481 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.269621 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.269769 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.269920 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.270067 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.270207 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.270346 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.270493 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.270633 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.270772 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.270911 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.271059 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.271198 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.271345 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.271491 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.271638 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.271794 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.271936 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.272075 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.272221 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.272362 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.272501 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.272641 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.272779 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.272966 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.273123 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.273264 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.273403 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.273543 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.273702 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.273843 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.273991 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.274132 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.274272 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.274412 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.274558 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.274773 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.274915 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.275062 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.275202 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.275348 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.275487 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.275645 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.275786 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.275932 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.276071 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.276211 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.276349 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.276500 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.276641 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.276779 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.276952 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.277094 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.277233 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.277380 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.277536 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.277676 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.277815 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.277953 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.278189 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.278336 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.278475 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.278614 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.278754 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.278929 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.279085 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.279237 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.279383 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.279533 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.279673 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.279848 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.280003 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.280144 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.280283 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.280457 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.280603 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.280767 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.280987 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.281131 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.281270 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.281411 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.281568 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.281715 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.281863 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.282003 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.282142 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.282302 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.282399 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.282560 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.282653 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.282882 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.282980 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.283193 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.283289 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.283502 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.283592 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.283824 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.283911 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.284155 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.284281 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.284466 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.284554 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.284768 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.284886 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.285103 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.285190 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.285416 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.285503 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.285721 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.285823 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.286033 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.286121 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.286343 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.286419 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.286655 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.286738 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.286967 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.287076 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.287301 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.287403 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.287589 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.287675 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.287895 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.287989 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.288200 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.288285 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.288514 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.288600 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.288821 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.288938 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.289149 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.289241 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.289459 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.289545 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.289773 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.289867 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.290079 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.290164 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.290388 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.290519 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.290695 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.290836 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.291007 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.291152 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.291313 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.291459 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.291740 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.291828 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.292053 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.292138 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.292365 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.292450 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.292672 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.292758 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.293006 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.293096 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.293319 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.293483 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.293635 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.294334 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.294581 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.294774 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.294955 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.295099 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.295253 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.295402 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.295542 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.295681 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.295820 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.295971 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.296124 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.296270 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.296423 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.296564 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.296710 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.296890 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.297038 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.297179 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.297317 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.297483 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.297625 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.297772 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.297913 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.298062 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.298203 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.298390 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.298538 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.298708 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.298863 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.299003 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.299142 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.299418 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.299576 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.299716 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.299856 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.300039 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.300198 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.300367 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.300526 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.300694 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.300885 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.301054 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.301200 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.301364 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.301522 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.301682 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.301834 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.301997 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.302143 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.302327 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.302483 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.302630 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.302775 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.302914 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.303061 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.303243 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.303400 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.303540 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.303677 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.303864 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.304011 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.304238 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.304380 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.304519 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.304686 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.304826 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.304994 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.305144 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.305284 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.305423 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.305569 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.305750 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.305897 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.306164 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.306327 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.306487 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.306636 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.306777 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.306922 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.307089 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.307248 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.307401 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.307542 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.307681 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.307827 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.307989 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.308136 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.308293 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.308433 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.308595 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.308743 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.308911 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.309073 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.309244 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.309984 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.310190 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.310363 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.310505 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.310653 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.310795 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.310952 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.311092 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.311231 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.311370 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.311517 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.311658 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.311798 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.311937 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.312075 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.312221 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.312372 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.312513 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.312658 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.312812 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.312982 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.313159 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.313317 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.313484 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.313631 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.313793 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.313942 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.314089 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.314228 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.314400 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.314546 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.314717 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.314872 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.315084 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.315227 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.315373 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.315513 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.315659 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.315807 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.315956 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.316097 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.316235 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.316381 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.316565 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.316723 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.316915 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.317065 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.317206 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.317352 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.317544 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.317700 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.317871 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.318017 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.318180 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.318328 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.318489 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.318644 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.318796 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.318936 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.319097 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.319244 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.319397 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.319545 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.319685 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.319824 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.320236 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.320385 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.320545 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.320802 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.320974 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.321127 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.321268 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.321406 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.321545 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.321698 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.321841 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.321979 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.322118 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.322266 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.322435 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.322577 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.322716 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.322855 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.323005 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.323144 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.323296 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.323443 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.323583 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.323722 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.323861 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.323999 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.324146 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.324311 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.324462 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.324602 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.324742 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.325003 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.325167 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.325347 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.325496 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.325779 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.325925 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.326110 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.326259 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.326421 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.326591 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.326734 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.326872 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.327030 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.327172 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.327353 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.327499 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.327670 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.327816 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.327984 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.328131 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.328301 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.328447 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.328613 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.328756 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.328965 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.329132 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.329282 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.329423 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.329564 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.329704 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.329852 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.330073 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.330221 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.330406 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.330650 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.330824 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.330967 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.331107 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.331280 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.331428 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.331592 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.331748 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.331889 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.332036 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.332204 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.332352 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.332517 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.332676 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.332866 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.333015 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.333164 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.333314 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.333464 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.333605 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.333751 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.333892 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.334038 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.334177 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.334365 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.334514 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.334697 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.334855 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.335027 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.335183 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.335331 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.335471 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.335643 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.335790 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.335959 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.336114 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.336260 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.336406 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.336594 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.336742 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.336951 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.337103 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.337243 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.337389 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.337530 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.337675 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.337824 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.337972 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.338138 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.338286 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.338448 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.338594 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.338756 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.338906 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.339053 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.339194 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.339356 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.339503 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.339652 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.339792 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.339967 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.340119 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.340260 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.340408 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.340584 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.340742 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.340925 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.341178 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.341328 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.341505 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.341654 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.341823 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.341971 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.342145 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.342292 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.342466 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.342667 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.342985 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.343133 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.343301 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.343458 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.343637 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.343784 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.343963 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.344108 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.344280 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.344500 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.344643 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.344781 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.344977 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.345131 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.345280 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.345429 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.345569 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.345708 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.345847 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.345985 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.346124 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.346275 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.346418 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.346555 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.346725 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.346872 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.347043 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.347198 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.347339 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.347479 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.347648 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.347794 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.347946 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.348087 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.348267 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.348478 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.348801 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.348981 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.349157 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.349314 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.349477 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.349623 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.349806 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.349953 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.350127 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.350274 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.350441 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.350590 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.350736 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.350876 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.351060 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.351217 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.351358 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.351504 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.351646 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.351793 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.351964 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.352118 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.352259 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.352404 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.352566 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.352723 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.352895 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.353047 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.353204 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.353345 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.353491 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.353638 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.353778 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.353924 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.354064 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.354204 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.354372 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.354529 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.354703 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.354859 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.354999 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.355149 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.355298 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.355438 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.355578 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.355752 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.355898 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.356676 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.357014 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.357293 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.357450 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.357626 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.357774 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.357951 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.358117 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.358258 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.358398 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.358581 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.358728 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.358897 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.359053 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.359194 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.359332 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.359497 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.359650 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.359791 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.359939 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.360090 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.360230 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.360407 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.360555 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.360703 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.360869 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.361067 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.361213 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.361381 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.361528 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.361679 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.361819 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.361999 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.362156 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.362296 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.362435 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.362611 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.362758 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.362929 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.363075 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.363247 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.363395 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.363600 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.363777 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.363933 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.364114 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.364451 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.364599 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.364791 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.364974 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.365158 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.365315 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.365469 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.365587 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.365780 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.365893 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.366087 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.366182 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.366410 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.366508 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.366723 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.366819 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.367033 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.367120 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.367346 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.367443 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.367659 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.367744 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.367967 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.368074 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.368279 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.368388 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.368587 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.368673 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.368919 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.369010 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.369234 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.369320 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.369540 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.369625 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.369851 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.369936 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.370164 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.370257 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.370479 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.370565 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.370803 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.370887 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.371119 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.371213 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.371436 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.371522 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.371748 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.372531 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.372531 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.372968 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.373046 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.373137 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.373265 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.373369 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.373584 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.373680 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.373894 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.373988 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.374215 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.374315 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.374530 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.374623 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.374857 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.375140 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.375229 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.375463 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.375628 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.375774 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.375916 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.376094 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.376252 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.376394 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.376541 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.376718 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.376886 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.377070 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.377236 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.377377 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.377517 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.377694 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.377842 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.378006 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.378186 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.378329 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.378476 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.378661 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.378809 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.378990 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.379145 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.379314 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.379461 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.379621 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.379768 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.379917 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.380058 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.380217 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.380364 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.380525 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.380672 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.380824 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.381019 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.381184 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.381331 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.381503 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.381652 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.381804 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.381949 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.382120 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.382304 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.382455 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.382605 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.382745 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.382886 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.383043 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.383184 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.383351 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.383511 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.383653 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.383792 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.383973 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.384128 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.384269 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.384416 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.384584 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.384738 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.384912 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.385068 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.385209 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.385357 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.385519 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.385667 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.385813 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.385953 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.386131 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.386279 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.386454 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.386608 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.386747 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.386896 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.387075 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.387227 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.387376 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.387556 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.387755 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.387903 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.388073 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.388222 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.388371 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.388518 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.388703 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.388945 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.389096 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.389328 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.389476 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.389638 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.389790 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.389940 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.390081 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.390245 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.390846 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.391003 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.391144 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.391293 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.391453 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.391453 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.391728 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.391869 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.392024 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.392024 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.392306 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.392306 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.392580 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.392580 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.392879 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.393039 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.393191 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.393191 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.393472 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.393472 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 01:21:51.393789 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.393789 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:21:51.394066 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 01:21:51.417150 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG oslo_db.sqlalchemy.engines [None req-c36629fa-d860-468e-a333-fa8a9ea521ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93622) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 01:21:51.419735 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG oslo_db.sqlalchemy.engines [None req-c3d2a52e-cb06-413a-bfee-dd287fa94e1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93623) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 01:21:51.495967 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.context [None req-c36629fa-d860-468e-a333-fa8a9ea521ac None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2d291931-575f-426d-9dd3-f69ed6f115bd(cell1) {{(pid=93622) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 01:21:51.496222 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.context [None req-c3d2a52e-cb06-413a-bfee-dd287fa94e1d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2d291931-575f-426d-9dd3-f69ed6f115bd(cell1) {{(pid=93623) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 01:21:51.500950 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG oslo_concurrency.lockutils [None req-c36629fa-d860-468e-a333-fa8a9ea521ac None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:21:51.501066 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG oslo_concurrency.lockutils [None req-c3d2a52e-cb06-413a-bfee-dd287fa94e1d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:21:51.502530 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG oslo_concurrency.lockutils [None req-c36629fa-d860-468e-a333-fa8a9ea521ac None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:21:51.502624 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG oslo_concurrency.lockutils [None req-c3d2a52e-cb06-413a-bfee-dd287fa94e1d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:21:51.503355 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG oslo_concurrency.lockutils [None req-c36629fa-d860-468e-a333-fa8a9ea521ac None None] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:21:51.503443 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG oslo_concurrency.lockutils [None req-c3d2a52e-cb06-413a-bfee-dd287fa94e1d None None] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:21:51.505367 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG oslo_concurrency.lockutils [None req-c3d2a52e-cb06-413a-bfee-dd287fa94e1d None None] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:21:51.505470 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG oslo_concurrency.lockutils [None req-c36629fa-d860-468e-a333-fa8a9ea521ac None None] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:21:51.518253 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG oslo_db.sqlalchemy.engines [None req-c3d2a52e-cb06-413a-bfee-dd287fa94e1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93623) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 01:21:51.519674 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG oslo_db.sqlalchemy.engines [None req-c3d2a52e-cb06-413a-bfee-dd287fa94e1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93623) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 01:21:51.611660 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG oslo_db.sqlalchemy.engines [None req-c36629fa-d860-468e-a333-fa8a9ea521ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93622) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 01:21:51.613800 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG oslo_db.sqlalchemy.engines [None req-c36629fa-d860-468e-a333-fa8a9ea521ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93622) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 01:21:51.867254 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG oslo_db.sqlalchemy.engines [None req-c3d2a52e-cb06-413a-bfee-dd287fa94e1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93623) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 01:21:51.876562 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG oslo_db.sqlalchemy.engines [None req-c36629fa-d860-468e-a333-fa8a9ea521ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93622) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 01:21:52.277389 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: WARNING keystonemiddleware.auth_token [None req-c3d2a52e-cb06-413a-bfee-dd287fa94e1d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 01:21:52.283860 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: WARNING keystonemiddleware.auth_token [None req-c3d2a52e-cb06-413a-bfee-dd287fa94e1d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 01:21:52.350222 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: WARNING keystonemiddleware.auth_token [None req-c36629fa-d860-468e-a333-fa8a9ea521ac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 01:21:52.357397 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: WARNING keystonemiddleware.auth_token [None req-c36629fa-d860-468e-a333-fa8a9ea521ac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 01:21:52.626332 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: WARNING keystonemiddleware.auth_token [None req-c3d2a52e-cb06-413a-bfee-dd287fa94e1d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 01:21:52.631525 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: WARNING keystonemiddleware.auth_token [None req-c3d2a52e-cb06-413a-bfee-dd287fa94e1d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 01:21:52.637025 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f76ab329c0 pid: 93623 (default app) Aug 27 01:21:52.639330 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-c3d2a52e-cb06-413a-bfee-dd287fa94e1d None None] Calling method '>' {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:21:52.640529 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-c3d2a52e-cb06-413a-bfee-dd287fa94e1d None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001870 Aug 27 01:21:52.640964 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 789 bytes} [Fri Aug 27 01:21:52 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:21:52.723224 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: WARNING keystonemiddleware.auth_token [None req-c36629fa-d860-468e-a333-fa8a9ea521ac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 01:21:52.728411 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: WARNING keystonemiddleware.auth_token [None req-c36629fa-d860-468e-a333-fa8a9ea521ac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 01:21:52.734887 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f76ab329c0 pid: 93622 (default app) Aug 27 01:23:15.719134 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-c3d2a52e-cb06-413a-bfee-dd287fa94e1d None None] Calling method '>' {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:23:15.720148 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-c3d2a52e-cb06-413a-bfee-dd287fa94e1d None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 27 01:23:15.720538 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 931 bytes} [Fri Aug 27 01:23:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:23:16.151456 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-5519117a-fe3d-41c1-9497-012d8e3d918a admin admin] Calling method '>' {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:23:16.180214 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-5519117a-fe3d-41c1-9497-012d8e3d918a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.452398 Aug 27 01:23:16.188918 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1292 bytes} [Fri Aug 27 01:23:15 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:23:18.394476 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-c3d2a52e-cb06-413a-bfee-dd287fa94e1d None None] Calling method '>' {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:23:18.396072 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-c3d2a52e-cb06-413a-bfee-dd287fa94e1d None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002017 Aug 27 01:23:18.396636 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 931 bytes} [Fri Aug 27 01:23:18 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:23:18.461554 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-57030d74-e933-47f1-a9a0-d54206e821d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "c1", "name": "cirros256", "os-flavor-access:is_public": true, "ram": 256, "rxtx_factor": 1.0, "swap": 0}} {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:23:18.480247 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:23:18.480247 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: warnings.warn(msg) Aug 27 01:23:18.567043 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-57030d74-e933-47f1-a9a0-d54206e821d5 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.163599 Aug 27 01:23:18.568279 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Aug 27 01:23:18 2021] POST /compute/v2.1/flavors => generated 407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:23:18.788065 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-6eacfdb5-9942-445c-89fe-ceb1896d1de5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:23:18.790420 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:23:18.790420 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: warnings.warn(msg) Aug 27 01:23:18.897846 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-6eacfdb5-9942-445c-89fe-ceb1896d1de5 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.321002 Aug 27 01:23:18.898631 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1336 bytes} [Fri Aug 27 01:23:18 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:23:21.105928 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-57030d74-e933-47f1-a9a0-d54206e821d5 admin admin] Calling method '>' {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:23:21.106965 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-57030d74-e933-47f1-a9a0-d54206e821d5 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 27 01:23:21.107584 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 931 bytes} [Fri Aug 27 01:23:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:23:21.215107 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-aa6f7d98-b80d-439c-8ae2-72f93c6fa346 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds512M", "swap": 0}} {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:23:21.233809 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:23:21.233809 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: warnings.warn(msg) Aug 27 01:23:21.312313 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-aa6f7d98-b80d-439c-8ae2-72f93c6fa346 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.198509 Aug 27 01:23:21.312799 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Aug 27 01:23:21 2021] POST /compute/v2.1/flavors => generated 404 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:23:21.326352 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-38f4cc5d-ed56-4ebc-a597-1c07339285b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:23:21.327936 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:23:21.327936 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: warnings.warn(msg) Aug 27 01:23:21.424426 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-38f4cc5d-ed56-4ebc-a597-1c07339285b6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102095 Aug 27 01:23:21.425600 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1336 bytes} [Fri Aug 27 01:23:21 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:23:23.675246 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-aa6f7d98-b80d-439c-8ae2-72f93c6fa346 admin admin] Calling method '>' {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:23:23.676763 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-aa6f7d98-b80d-439c-8ae2-72f93c6fa346 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002070 Aug 27 01:23:23.677191 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 931 bytes} [Fri Aug 27 01:23:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:23:23.740451 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-1839bcbc-a362-4e53-9b57-8216a848a68b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds1G", "rxtx_factor": 1.0, "swap": 0, "ram": 1024, "disk": 10, "id": "d2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:23:23.842642 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-1839bcbc-a362-4e53-9b57-8216a848a68b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.158747 Aug 27 01:23:23.850570 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Aug 27 01:23:23 2021] POST /compute/v2.1/flavors => generated 404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:23:23.856606 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-3c8c7047-7c9f-4a20-87a5-9b10bfc4f5c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:23:23.925811 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-3c8c7047-7c9f-4a20-87a5-9b10bfc4f5c8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073768 Aug 27 01:23:23.926625 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1336 bytes} [Fri Aug 27 01:23:23 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:23:26.140969 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-1839bcbc-a362-4e53-9b57-8216a848a68b admin admin] Calling method '>' {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:23:26.142006 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-1839bcbc-a362-4e53-9b57-8216a848a68b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Aug 27 01:23:26.142403 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 931 bytes} [Fri Aug 27 01:23:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:23:26.206474 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-c565b796-d5c5-4a70-ac32-d357c58583cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "name": "ds2G", "swap": 0, "ram": 2048, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d3"}} {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:23:26.282078 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-c565b796-d5c5-4a70-ac32-d357c58583cb admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.132757 Aug 27 01:23:26.282556 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Aug 27 01:23:26 2021] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:23:26.295263 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-b9f75b80-2027-4463-a02a-35c2eed86a8b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:23:26.387095 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-b9f75b80-2027-4463-a02a-35c2eed86a8b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096010 Aug 27 01:23:26.387865 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1336 bytes} [Fri Aug 27 01:23:26 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:23:28.620076 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-c565b796-d5c5-4a70-ac32-d357c58583cb admin admin] Calling method '>' {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:23:28.621136 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-c565b796-d5c5-4a70-ac32-d357c58583cb admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002208 Aug 27 01:23:28.621854 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 931 bytes} [Fri Aug 27 01:23:28 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:23:28.691330 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-b874687e-7b1c-4bcd-b688-de54bda0cba8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0, "vcpus": 4, "name": "ds4G"}} {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:23:28.779215 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-b874687e-7b1c-4bcd-b688-de54bda0cba8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.150931 Aug 27 01:23:28.780103 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Aug 27 01:23:28 2021] POST /compute/v2.1/flavors => generated 404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:23:28.792881 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-6b0e3b1f-dba7-4614-a704-581cc5d6fb3a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:23:28.885618 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-6b0e3b1f-dba7-4614-a704-581cc5d6fb3a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097112 Aug 27 01:23:28.886371 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1336 bytes} [Fri Aug 27 01:23:28 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:23:31.132224 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-b874687e-7b1c-4bcd-b688-de54bda0cba8 admin admin] Calling method '>' {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:23:31.133739 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-b874687e-7b1c-4bcd-b688-de54bda0cba8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001730 Aug 27 01:23:31.134233 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 931 bytes} [Fri Aug 27 01:23:31 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:23:31.195791 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-d3869f62-64ab-43ff-98e2-1b9194cdcef5 admin admin] Calling method '>' {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:23:31.219108 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-d3869f62-64ab-43ff-98e2-1b9194cdcef5 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077552 Aug 27 01:23:31.219661 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1292 bytes} [Fri Aug 27 01:23:31 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:23:33.957272 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-b874687e-7b1c-4bcd-b688-de54bda0cba8 admin admin] Calling method '>' {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:23:33.958349 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-b874687e-7b1c-4bcd-b688-de54bda0cba8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Aug 27 01:23:33.958780 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 931 bytes} [Fri Aug 27 01:23:33 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:23:34.022992 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-e7060dd3-943d-44ea-93e8-75319b4a03d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "os-flavor-access:is_public": true, "ram": 512, "swap": 0}} {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:23:34.127184 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-e7060dd3-943d-44ea-93e8-75319b4a03d4 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.160402 Aug 27 01:23:34.127798 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Aug 27 01:23:33 2021] POST /compute/v2.1/flavors => generated 402 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:23:34.141676 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-46043988-f38b-41fb-94e9-30bdf4c3e08b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:23:34.217960 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-46043988-f38b-41fb-94e9-30bdf4c3e08b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080054 Aug 27 01:23:34.218625 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1333 bytes} [Fri Aug 27 01:23:34 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:23:36.705811 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-e7060dd3-943d-44ea-93e8-75319b4a03d4 admin admin] Calling method '>' {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:23:36.706802 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-e7060dd3-943d-44ea-93e8-75319b4a03d4 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Aug 27 01:23:36.707222 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 931 bytes} [Fri Aug 27 01:23:36 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:23:36.768720 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-2981679d-c437-4086-8491-603f9958f609 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "id": "2", "rxtx_factor": 1.0, "name": "m1.small"}} {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:23:36.858282 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-2981679d-c437-4086-8491-603f9958f609 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.143871 Aug 27 01:23:36.858852 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Aug 27 01:23:36 2021] POST /compute/v2.1/flavors => generated 405 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:23:36.871498 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-1ede0a2d-58e6-4234-9eae-8a6c361139d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:23:36.960094 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-1ede0a2d-58e6-4234-9eae-8a6c361139d1 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092609 Aug 27 01:23:36.960591 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1333 bytes} [Fri Aug 27 01:23:36 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:23:39.122885 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-2981679d-c437-4086-8491-603f9958f609 admin admin] Calling method '>' {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:23:39.123909 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-2981679d-c437-4086-8491-603f9958f609 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 27 01:23:39.124314 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 931 bytes} [Fri Aug 27 01:23:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:23:39.179938 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-9330dcab-9fc9-4105-bb41-67c917125f62 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "3", "swap": 0, "ram": 4096}} {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:23:39.276301 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-9330dcab-9fc9-4105-bb41-67c917125f62 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.145589 Aug 27 01:23:39.276919 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Aug 27 01:23:39 2021] POST /compute/v2.1/flavors => generated 406 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:23:39.289184 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-99dc9da9-9ce9-4f38-87c0-185fc00ea35c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:23:39.370589 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-99dc9da9-9ce9-4f38-87c0-185fc00ea35c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084900 Aug 27 01:23:39.371336 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1333 bytes} [Fri Aug 27 01:23:39 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:23:41.591519 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-9330dcab-9fc9-4105-bb41-67c917125f62 admin admin] Calling method '>' {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:23:41.592717 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-9330dcab-9fc9-4105-bb41-67c917125f62 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001630 Aug 27 01:23:41.593293 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 931 bytes} [Fri Aug 27 01:23:41 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:23:41.655098 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-50dc4f0f-4e90-4dea-b527-298abdc9bf3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "disk": 80, "name": "m1.large", "swap": 0, "os-flavor-access:is_public": true, "ram": 8192, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:23:41.733297 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-50dc4f0f-4e90-4dea-b527-298abdc9bf3f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.133654 Aug 27 01:23:41.733768 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Aug 27 01:23:41 2021] POST /compute/v2.1/flavors => generated 405 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:23:41.748372 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-2074952b-a4d2-418c-9657-b9a7dd6b1cfe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:23:41.834636 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-2074952b-a4d2-418c-9657-b9a7dd6b1cfe admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089889 Aug 27 01:23:41.835596 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1333 bytes} [Fri Aug 27 01:23:41 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:23:44.079793 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-50dc4f0f-4e90-4dea-b527-298abdc9bf3f admin admin] Calling method '>' {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:23:44.080949 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-50dc4f0f-4e90-4dea-b527-298abdc9bf3f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Aug 27 01:23:44.081421 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 931 bytes} [Fri Aug 27 01:23:44 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:23:44.144389 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-b79d8523-988a-432b-a5b7-b93bc1701de9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "name": "m1.xlarge", "disk": 160, "id": "5"}} {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:23:44.276148 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-b79d8523-988a-432b-a5b7-b93bc1701de9 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.187773 Aug 27 01:23:44.277001 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Aug 27 01:23:44 2021] POST /compute/v2.1/flavors => generated 408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:23:44.289099 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-ed87e2e4-32c4-4bcd-829e-eb49b1c60400 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:23:44.371448 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-ed87e2e4-32c4-4bcd-829e-eb49b1c60400 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085872 Aug 27 01:23:44.372194 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1333 bytes} [Fri Aug 27 01:23:44 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:24:23.001213 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-b79d8523-988a-432b-a5b7-b93bc1701de9 admin admin] Calling method '>' {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:24:23.002214 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-b79d8523-988a-432b-a5b7-b93bc1701de9 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 27 01:24:23.002598 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 931 bytes} [Fri Aug 27 01:24:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:24:23.060633 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-438261d8-2911-4959-9bef-62efd7ad4f6f admin admin] Calling method '>' {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:24:23.079501 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-438261d8-2911-4959-9bef-62efd7ad4f6f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069837 Aug 27 01:24:23.080036 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1292 bytes} [Fri Aug 27 01:24:23 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:24:24.558559 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-b79d8523-988a-432b-a5b7-b93bc1701de9 admin admin] Calling method '>' {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:24:24.559883 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-b79d8523-988a-432b-a5b7-b93bc1701de9 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 27 01:24:24.560280 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1075 bytes} [Fri Aug 27 01:24:24 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:24:24.748908 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-60349ffd-464a-498d-8b26-1cae8c6851f5 admin admin] Calling method '>' {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:24:24.754189 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.wsgi [None req-60349ffd-464a-498d-8b26-1cae8c6851f5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 27 01:24:24.754755 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-60349ffd-464a-498d-8b26-1cae8c6851f5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:24:24.755539 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-60349ffd-464a-498d-8b26-1cae8c6851f5 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.057037 Aug 27 01:24:24.756035 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1191 bytes} [Fri Aug 27 01:24:24 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 01:24:24.766527 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-e63d2992-2d30-49d7-b47d-241d5effdc8b admin admin] Calling method '>' {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:24:24.786503 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-e63d2992-2d30-49d7-b47d-241d5effdc8b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023506 Aug 27 01:24:24.787016 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1211 bytes} [Fri Aug 27 01:24:24 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:24:24.797006 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-d914539f-6a3d-4a4a-831f-b00506858b2c admin admin] Calling method '>' {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:24:24.818732 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-d914539f-6a3d-4a4a-831f-b00506858b2c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025161 Aug 27 01:24:24.819267 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1211 bytes} [Fri Aug 27 01:24:24 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:24:24.830152 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-d49f9c62-ab7d-46a4-b498-e9e7bde45efe admin admin] Calling method '>' {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:24:24.835433 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.wsgi [None req-d49f9c62-ab7d-46a4-b498-e9e7bde45efe admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 27 01:24:24.836002 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-d49f9c62-ab7d-46a4-b498-e9e7bde45efe admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:24:24.836792 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-d49f9c62-ab7d-46a4-b498-e9e7bde45efe admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.010205 Aug 27 01:24:24.837312 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1191 bytes} [Fri Aug 27 01:24:24 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 01:24:26.190470 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-d914539f-6a3d-4a4a-831f-b00506858b2c admin admin] Calling method '>' {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:24:26.191738 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-d914539f-6a3d-4a4a-831f-b00506858b2c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 27 01:24:26.192119 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1075 bytes} [Fri Aug 27 01:24:26 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:24:26.382884 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-5c04ed2d-ce84-4cf1-ba62-aa26b159220e admin admin] Calling method '>' {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:24:26.388440 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.wsgi [None req-5c04ed2d-ce84-4cf1-ba62-aa26b159220e admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 27 01:24:26.389053 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-5c04ed2d-ce84-4cf1-ba62-aa26b159220e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:24:26.389843 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-5c04ed2d-ce84-4cf1-ba62-aa26b159220e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.060294 Aug 27 01:24:26.390350 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1191 bytes} [Fri Aug 27 01:24:26 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 01:24:26.400454 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-3ce1c845-49d2-4854-a8f1-70984773ea90 admin admin] Calling method '>' {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:24:26.414088 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-3ce1c845-49d2-4854-a8f1-70984773ea90 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.016767 Aug 27 01:24:26.415600 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1211 bytes} [Fri Aug 27 01:24:26 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:24:26.424486 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-cc079496-a6e3-42c9-b123-7a96eed45b72 admin admin] Calling method '>' {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:24:26.438642 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-cc079496-a6e3-42c9-b123-7a96eed45b72 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017613 Aug 27 01:24:26.439158 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1211 bytes} [Fri Aug 27 01:24:26 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:24:26.449255 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-137c5c64-8504-4542-97b6-92bfba8c3f34 admin admin] Calling method '>' {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:24:26.454546 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.wsgi [None req-137c5c64-8504-4542-97b6-92bfba8c3f34 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 27 01:24:26.455107 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-137c5c64-8504-4542-97b6-92bfba8c3f34 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:24:26.455909 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-137c5c64-8504-4542-97b6-92bfba8c3f34 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.010240 Aug 27 01:24:26.456389 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1191 bytes} [Fri Aug 27 01:24:26 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 27 01:24:27.793476 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-cc079496-a6e3-42c9-b123-7a96eed45b72 admin admin] Calling method '>' {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:24:27.794494 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-cc079496-a6e3-42c9-b123-7a96eed45b72 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Aug 27 01:24:27.794892 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1075 bytes} [Fri Aug 27 01:24:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:24:27.982758 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-42571c6a-f75b-41ab-be81-8fe09f1daee0 admin admin] Calling method '>' {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:24:27.988354 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.wsgi [None req-42571c6a-f75b-41ab-be81-8fe09f1daee0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 27 01:24:27.988951 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-42571c6a-f75b-41ab-be81-8fe09f1daee0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:24:27.989741 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-42571c6a-f75b-41ab-be81-8fe09f1daee0 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.057545 Aug 27 01:24:27.990234 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1194 bytes} [Fri Aug 27 01:24:27 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 01:24:27.999868 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-d8463929-e891-42d4-afaa-b15d14311708 admin admin] Calling method '>' {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:24:28.013633 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-d8463929-e891-42d4-afaa-b15d14311708 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017178 Aug 27 01:24:28.014083 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1211 bytes} [Fri Aug 27 01:24:27 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:24:28.024165 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-5e818038-7204-449f-9805-56566d5a977b admin admin] Calling method '>' {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:24:28.037088 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-5e818038-7204-449f-9805-56566d5a977b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.016921 Aug 27 01:24:28.037595 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1211 bytes} [Fri Aug 27 01:24:28 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:24:28.046873 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-b10274a8-4dcf-4630-b991-bcddcafcfb40 admin admin] Calling method '>' {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:24:28.051858 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.wsgi [None req-b10274a8-4dcf-4630-b991-bcddcafcfb40 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 27 01:24:28.052415 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-b10274a8-4dcf-4630-b991-bcddcafcfb40 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:24:28.053233 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-b10274a8-4dcf-4630-b991-bcddcafcfb40 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.009684 Aug 27 01:24:28.053703 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1194 bytes} [Fri Aug 27 01:24:28 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 27 01:24:29.414465 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-5e818038-7204-449f-9805-56566d5a977b admin admin] Calling method '>' {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:24:29.419995 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-5e818038-7204-449f-9805-56566d5a977b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001981 Aug 27 01:24:29.419995 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1075 bytes} [Fri Aug 27 01:24:29 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:24:29.605550 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-0289c59a-58a5-41e5-92ba-0cb01be2d35d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:24:29.695140 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-0289c59a-58a5-41e5-92ba-0cb01be2d35d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.141106 Aug 27 01:24:29.695688 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1236 bytes} [Fri Aug 27 01:24:29 2021] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:24:31.049133 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-5e818038-7204-449f-9805-56566d5a977b admin admin] Calling method '>' {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:24:31.050145 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-5e818038-7204-449f-9805-56566d5a977b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 27 01:24:31.050551 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1075 bytes} [Fri Aug 27 01:24:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:24:31.244175 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-1003a1fc-a146-4792-bfda-0ab8507c66f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:24:31.325419 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-1003a1fc-a146-4792-bfda-0ab8507c66f9 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.132186 Aug 27 01:24:31.325954 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1236 bytes} [Fri Aug 27 01:24:31 2021] POST /compute/v2.1/flavors => generated 405 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:24:32.667527 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-5e818038-7204-449f-9805-56566d5a977b admin admin] Calling method '>' {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:24:32.668585 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-5e818038-7204-449f-9805-56566d5a977b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 27 01:24:32.668999 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1075 bytes} [Fri Aug 27 01:24:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:24:32.858237 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-55cb2bc4-25ba-4eef-9aff-fd88ea3c3a09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:24:32.929926 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-55cb2bc4-25ba-4eef-9aff-fd88ea3c3a09 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.121778 Aug 27 01:24:32.930238 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1236 bytes} [Fri Aug 27 01:24:32 2021] POST /compute/v2.1/flavors => generated 407 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:24:34.265481 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-5e818038-7204-449f-9805-56566d5a977b admin admin] Calling method '>' {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:24:34.266491 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-5e818038-7204-449f-9805-56566d5a977b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 27 01:24:34.266878 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1075 bytes} [Fri Aug 27 01:24:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:24:34.462519 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-83d7be3a-af06-4b6b-96bb-1c2a10fb7501 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:24:34.565292 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-83d7be3a-af06-4b6b-96bb-1c2a10fb7501 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.154368 Aug 27 01:24:34.565770 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1236 bytes} [Fri Aug 27 01:24:34 2021] POST /compute/v2.1/flavors => generated 409 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:24:35.908574 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-5e818038-7204-449f-9805-56566d5a977b admin admin] Calling method '>' {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:24:35.909649 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-5e818038-7204-449f-9805-56566d5a977b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 27 01:24:35.910072 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1075 bytes} [Fri Aug 27 01:24:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:24:36.098377 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-fc332d0c-032c-4996-aeb6-de86f4d9a472 admin admin] Calling method '>' {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:24:36.117719 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-fc332d0c-032c-4996-aeb6-de86f4d9a472 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.069973 Aug 27 01:24:36.118182 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1203 bytes} [Fri Aug 27 01:24:36 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:25:21.232407 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-5e818038-7204-449f-9805-56566d5a977b admin admin] Calling method '>' {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:25:21.233544 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-5e818038-7204-449f-9805-56566d5a977b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 27 01:25:21.234339 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 931 bytes} [Fri Aug 27 01:25:21 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:25:21.296670 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-79482cb2-95a9-45e6-af5f-9f6b4c05bf59 admin admin] Calling method '>' {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:25:21.315684 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-79482cb2-95a9-45e6-af5f-9f6b4c05bf59 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074080 Aug 27 01:25:21.316213 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1292 bytes} [Fri Aug 27 01:25:21 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:25:21.339763 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-1caf4614-f7e3-4f91-a271-55c1b5ca63e4 admin admin] Calling method '>' {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:25:21.347164 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-1caf4614-f7e3-4f91-a271-55c1b5ca63e4 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010929 Aug 27 01:25:21.347672 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 32/65] 10.222.0.25 () {60 vars in 1283 bytes} [Fri Aug 27 01:25:21 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:25:21.359116 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-afcc9b64-e255-4348-8915-860170f589a6 admin admin] Calling method '>' {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:25:21.366728 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-afcc9b64-e255-4348-8915-860170f589a6 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011074 Aug 27 01:25:21.367241 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 34/66] 10.222.0.25 () {60 vars in 1286 bytes} [Fri Aug 27 01:25:21 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:25:21.378833 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-f4a98ce7-90b1-415a-872d-e077d706b818 admin admin] Calling method '>' {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:25:21.387023 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-f4a98ce7-90b1-415a-872d-e077d706b818 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011616 Aug 27 01:25:21.387550 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1286 bytes} [Fri Aug 27 01:25:21 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:25:21.401524 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-dfc04b83-10e8-43db-80b3-0388d7f97011 admin admin] Calling method '>' {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:25:21.409932 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-dfc04b83-10e8-43db-80b3-0388d7f97011 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013797 Aug 27 01:25:21.410463 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 35/68] 10.222.0.25 () {60 vars in 1283 bytes} [Fri Aug 27 01:25:21 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:26:51.557685 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-4f17a430-6337-4a4c-b587-e3fc3e157a03 tempest-verify_tempest_config-921997181 tempest-verify_tempest_config-921997181-project] Calling method '>' {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:26:51.559656 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-4f17a430-6337-4a4c-b587-e3fc3e157a03 tempest-verify_tempest_config-921997181 tempest-verify_tempest_config-921997181-project] 10.222.0.25 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.109244 Aug 27 01:26:51.560182 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 34/69] 10.222.0.25 () {58 vars in 1134 bytes} [Fri Aug 27 01:26:51 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:28:18.088756 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-dfc04b83-10e8-43db-80b3-0388d7f97011 admin admin] Calling method '>' {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:28:18.089803 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-dfc04b83-10e8-43db-80b3-0388d7f97011 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 27 01:28:18.090204 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 36/70] 10.222.0.25 () {56 vars in 1075 bytes} [Fri Aug 27 01:28:18 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:28:18.343792 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-9ce0c318-b83f-4ddb-b3ea-e21b27c52a49 admin admin] Calling method '>' {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:28:18.345010 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:28:18.345010 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: warnings.warn(msg) Aug 27 01:28:18.346524 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG oslo_concurrency.lockutils [None req-9ce0c318-b83f-4ddb-b3ea-e21b27c52a49 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:28:18.346964 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG oslo_concurrency.lockutils [None req-9ce0c318-b83f-4ddb-b3ea-e21b27c52a49 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:28:18.347748 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG oslo_concurrency.lockutils [None req-9ce0c318-b83f-4ddb-b3ea-e21b27c52a49 admin admin] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:28:18.348180 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG oslo_concurrency.lockutils [None req-9ce0c318-b83f-4ddb-b3ea-e21b27c52a49 admin admin] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:28:18.381650 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-9ce0c318-b83f-4ddb-b3ea-e21b27c52a49 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.149148 Aug 27 01:28:18.382192 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 35/71] 10.222.0.25 () {60 vars in 1194 bytes} [Fri Aug 27 01:28:18 2021] GET /compute/v2.1/os-services => generated 791 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:28:19.730159 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-dfc04b83-10e8-43db-80b3-0388d7f97011 admin admin] Calling method '>' {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:28:19.731158 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-dfc04b83-10e8-43db-80b3-0388d7f97011 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Aug 27 01:28:19.731545 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 37/72] 10.222.0.25 () {56 vars in 1075 bytes} [Fri Aug 27 01:28:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:28:19.918649 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-f8af192d-6d2b-4995-8be8-4ddb4d27aaa7 admin admin] Calling method '>' {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:28:19.919787 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:28:19.919787 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: warnings.warn(msg) Aug 27 01:28:19.921312 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG oslo_concurrency.lockutils [None req-f8af192d-6d2b-4995-8be8-4ddb4d27aaa7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:28:19.921747 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG oslo_concurrency.lockutils [None req-f8af192d-6d2b-4995-8be8-4ddb4d27aaa7 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:28:19.922517 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG oslo_concurrency.lockutils [None req-f8af192d-6d2b-4995-8be8-4ddb4d27aaa7 admin admin] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:28:19.922939 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG oslo_concurrency.lockutils [None req-f8af192d-6d2b-4995-8be8-4ddb4d27aaa7 admin admin] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:28:19.942862 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-f8af192d-6d2b-4995-8be8-4ddb4d27aaa7 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.073976 Aug 27 01:28:19.943344 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 36/73] 10.222.0.25 () {60 vars in 1194 bytes} [Fri Aug 27 01:28:19 2021] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:28:31.745674 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-dfc04b83-10e8-43db-80b3-0388d7f97011 admin admin] Calling method '>' {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:28:31.746720 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-dfc04b83-10e8-43db-80b3-0388d7f97011 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Aug 27 01:28:31.747110 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 38/74] 10.222.0.25 () {56 vars in 1075 bytes} [Fri Aug 27 01:28:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:28:31.944267 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-202aa6fd-574d-4653-bdbe-c567c6b1c0ab admin admin] Calling method '>' {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:28:31.944267 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:28:31.944267 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: warnings.warn(msg) Aug 27 01:28:31.944971 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG oslo_concurrency.lockutils [None req-202aa6fd-574d-4653-bdbe-c567c6b1c0ab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:28:31.945102 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG oslo_concurrency.lockutils [None req-202aa6fd-574d-4653-bdbe-c567c6b1c0ab admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:28:31.945893 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG oslo_concurrency.lockutils [None req-202aa6fd-574d-4653-bdbe-c567c6b1c0ab admin admin] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:28:31.946325 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG oslo_concurrency.lockutils [None req-202aa6fd-574d-4653-bdbe-c567c6b1c0ab admin admin] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:28:31.970537 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-202aa6fd-574d-4653-bdbe-c567c6b1c0ab admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.081204 Aug 27 01:28:31.971026 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 37/75] 10.222.0.25 () {60 vars in 1194 bytes} [Fri Aug 27 01:28:31 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:28:33.321132 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: DEBUG nova.api.openstack.wsgi [None req-dfc04b83-10e8-43db-80b3-0388d7f97011 admin admin] Calling method '>' {{(pid=93623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:28:33.322167 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: INFO nova.api.openstack.requestlog [None req-dfc04b83-10e8-43db-80b3-0388d7f97011 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Aug 27 01:28:33.322563 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: [pid: 93623|app: 0|req: 39/76] 10.222.0.25 () {56 vars in 1075 bytes} [Fri Aug 27 01:28:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:28:33.512358 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG nova.api.openstack.wsgi [None req-31d7fb0b-c9a5-403e-a8cd-b5d4139cc65f admin admin] Calling method '>' {{(pid=93622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:28:33.513544 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:28:33.513544 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: warnings.warn(msg) Aug 27 01:28:33.515086 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG oslo_concurrency.lockutils [None req-31d7fb0b-c9a5-403e-a8cd-b5d4139cc65f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:28:33.515521 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG oslo_concurrency.lockutils [None req-31d7fb0b-c9a5-403e-a8cd-b5d4139cc65f admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:28:33.516297 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG oslo_concurrency.lockutils [None req-31d7fb0b-c9a5-403e-a8cd-b5d4139cc65f admin admin] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:28:33.516720 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: DEBUG oslo_concurrency.lockutils [None req-31d7fb0b-c9a5-403e-a8cd-b5d4139cc65f admin admin] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:28:33.539108 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: INFO nova.api.openstack.requestlog [None req-31d7fb0b-c9a5-403e-a8cd-b5d4139cc65f admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.076795 Aug 27 01:28:33.539579 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: [pid: 93622|app: 0|req: 38/77] 10.222.0.25 () {60 vars in 1194 bytes} [Fri Aug 27 01:28:33 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:29:28.351988 dv-cinder-759169-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 27 01:29:28.352787 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: Fri Aug 27 01:29:28 2021 - graceful shutdown triggered... Aug 27 01:29:28.353274 dv-cinder-759169-3-iscsi devstack@n-api.service[93622]: Gracefully killing worker 1 (pid: 93622)... Aug 27 01:29:28.353650 dv-cinder-759169-3-iscsi devstack@n-api.service[93623]: Gracefully killing worker 2 (pid: 93623)... Aug 27 01:29:29.352462 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: worker 1 buried after 1 seconds Aug 27 01:29:29.352462 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: worker 2 buried after 1 seconds Aug 27 01:29:29.352462 dv-cinder-759169-3-iscsi devstack@n-api.service[93621]: goodbye to uWSGI. Aug 27 01:29:29.353976 dv-cinder-759169-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 27 01:29:29.354526 dv-cinder-759169-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 27 01:29:29.357398 dv-cinder-759169-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 27 01:29:29.367908 dv-cinder-759169-3-iscsi devstack@n-api.service[108743]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 27 01:29:29.369915 dv-cinder-759169-3-iscsi devstack@n-api.service[108743]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 27 01:29:29 2021] *** Aug 27 01:29:29.369915 dv-cinder-759169-3-iscsi devstack@n-api.service[108743]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 01:29:29.369915 dv-cinder-759169-3-iscsi devstack@n-api.service[108743]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 01:29:29.369915 dv-cinder-759169-3-iscsi devstack@n-api.service[108743]: nodename: dv-cinder-759169-3-iscsi Aug 27 01:29:29.369915 dv-cinder-759169-3-iscsi devstack@n-api.service[108743]: machine: x86_64 Aug 27 01:29:29.369915 dv-cinder-759169-3-iscsi devstack@n-api.service[108743]: clock source: unix Aug 27 01:29:29.369915 dv-cinder-759169-3-iscsi devstack@n-api.service[108743]: pcre jit disabled Aug 27 01:29:29.369915 dv-cinder-759169-3-iscsi devstack@n-api.service[108743]: detected number of CPU cores: 4 Aug 27 01:29:29.369915 dv-cinder-759169-3-iscsi devstack@n-api.service[108743]: current working directory: / Aug 27 01:29:29.369915 dv-cinder-759169-3-iscsi devstack@n-api.service[108743]: detected binary path: /usr/bin/uwsgi-core Aug 27 01:29:29.369915 dv-cinder-759169-3-iscsi devstack@n-api.service[108743]: your processes number limit is 47680 Aug 27 01:29:29.369915 dv-cinder-759169-3-iscsi devstack@n-api.service[108743]: your memory page size is 4096 bytes Aug 27 01:29:29.369915 dv-cinder-759169-3-iscsi devstack@n-api.service[108743]: detected max file descriptor number: 2048 Aug 27 01:29:29.369915 dv-cinder-759169-3-iscsi devstack@n-api.service[108743]: lock engine: pthread robust mutexes Aug 27 01:29:29.370773 dv-cinder-759169-3-iscsi devstack@n-api.service[108743]: thunder lock: enabled Aug 27 01:29:29.370773 dv-cinder-759169-3-iscsi devstack@n-api.service[108743]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 27 01:29:29.370773 dv-cinder-759169-3-iscsi devstack@n-api.service[108743]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 27 01:29:29.417669 dv-cinder-759169-3-iscsi devstack@n-api.service[108743]: Python main interpreter initialized at 0x559b58fca9c0 Aug 27 01:29:29.417669 dv-cinder-759169-3-iscsi devstack@n-api.service[108743]: python threads support enabled Aug 27 01:29:29.417669 dv-cinder-759169-3-iscsi devstack@n-api.service[108743]: your server socket listen backlog is limited to 100 connections Aug 27 01:29:29.417669 dv-cinder-759169-3-iscsi devstack@n-api.service[108743]: your mercy for graceful operations on workers is 90 seconds Aug 27 01:29:29.418032 dv-cinder-759169-3-iscsi devstack@n-api.service[108743]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 01:29:29.418121 dv-cinder-759169-3-iscsi devstack@n-api.service[108743]: *** Operational MODE: preforking *** Aug 27 01:29:29.418407 dv-cinder-759169-3-iscsi devstack@n-api.service[108743]: *** uWSGI is running in multiple interpreter mode *** Aug 27 01:29:29.418407 dv-cinder-759169-3-iscsi devstack@n-api.service[108743]: spawned uWSGI master process (pid: 108743) Aug 27 01:29:29.418609 dv-cinder-759169-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 27 01:29:29.419929 dv-cinder-759169-3-iscsi devstack@n-api.service[108743]: spawned uWSGI worker 1 (pid: 108755, cores: 1) Aug 27 01:29:29.419929 dv-cinder-759169-3-iscsi devstack@n-api.service[108743]: spawned uWSGI worker 2 (pid: 108756, cores: 1) Aug 27 01:29:29.419929 dv-cinder-759169-3-iscsi devstack@n-api.service[108743]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 01:29:31.243896 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 01:29:31.243896 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: from cryptography.utils import int_from_bytes Aug 27 01:29:31.244587 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 01:29:31.244587 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: from cryptography.utils import int_from_bytes Aug 27 01:29:31.332643 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 01:29:31.332643 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: from cryptography.utils import int_from_bytes Aug 27 01:29:31.333940 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 01:29:31.333940 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: from cryptography.utils import int_from_bytes Aug 27 01:29:33.821497 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 01:29:33.822041 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 01:29:33.822136 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 01:29:33.822501 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 01:29:33.822759 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 01:29:33.823145 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.823470 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.823796 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.824114 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.824441 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.824751 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.825105 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.825414 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.825739 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.826000 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.826316 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.826638 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-759169-3-iscsi {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.826959 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.827265 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.827578 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.827961 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.828350 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.828757 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.829093 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.831156 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.831156 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.831156 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.831156 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.831156 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.831565 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.831637 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.831906 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.832231 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.832548 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.832876 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.833268 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-759169-3-iscsi {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.833590 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.833909 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.834224 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.834624 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.834934 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.835243 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.835562 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.835889 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.836218 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.836547 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.836874 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.837199 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.837525 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.837814 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.838123 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.838431 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.838754 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.839054 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.839357 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.839606 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.839914 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.840232 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.840549 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.840884 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.841141 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.841392 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.841706 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.842024 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.842330 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.842636 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.842940 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.843237 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.843547 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.843849 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.844156 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.844471 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.844775 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.845328 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.845906 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.845906 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.846204 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.846505 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.846754 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.847061 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.847400 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.847715 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.848026 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.848342 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.848665 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.848995 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.849298 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.849604 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.849921 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.850241 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.850543 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.850794 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.851094 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.851397 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.851712 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.852018 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.852323 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.852627 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.852948 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.853254 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.853649 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.853859 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.854208 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.854464 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.854818 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.855070 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.855373 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.855674 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.855991 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.856307 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.856614 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.856936 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.857241 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.857547 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.857865 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.858171 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.858475 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.858798 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.859230 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.859408 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.859701 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.860008 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.860313 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.861304 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.861960 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.861960 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.862387 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.862702 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.863014 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.863319 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.863799 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.863970 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.864222 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.864525 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.864944 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.865152 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.865473 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.865792 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.866100 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.866405 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.866711 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.867025 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.867377 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.867709 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.868050 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.868365 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.868695 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.869049 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.869375 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.869686 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.869999 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.870325 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.870636 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.870946 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.871258 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.871575 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.871890 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.872218 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.872534 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.872863 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.873180 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.873492 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.873927 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.874128 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.874516 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.874759 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.875099 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.875439 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.875752 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.876092 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.877107 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.877782 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.877782 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.878101 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.878245 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.878557 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.878866 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.879231 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.879520 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.879827 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.879984 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 01:29:33.880474 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.880623 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 01:29:33.880777 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.880973 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 01:29:33.881118 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.881284 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 01:29:33.881597 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.881762 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 01:29:33.881921 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.881921 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.882201 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.882351 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.882879 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.883035 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.883266 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.883412 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.883566 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.883728 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.883899 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.884186 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.884336 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.884479 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.884746 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.884936 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.885082 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.885333 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.885491 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.885644 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.885787 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.885948 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.886115 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.886267 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.886420 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-759169-3-iscsi {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.886570 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.886714 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.886863 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.887039 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.887254 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.887410 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.887561 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.887718 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.887868 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.888030 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.888184 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.888327 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.888476 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.888703 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.888881 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.889130 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.889319 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.889574 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.889796 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.889954 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.890109 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.890264 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.890414 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.890567 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.890710 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.890858 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.891016 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.891206 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.891354 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.891504 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.891670 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.891894 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.892056 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.892735 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.892928 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.893089 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.893241 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.893394 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-759169-3-iscsi {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.893544 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.893688 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.893830 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.893984 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.894156 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.894156 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.894520 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.894669 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.894921 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.895081 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.895235 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.895512 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.895662 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.895805 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.895955 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.896105 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.896267 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.896412 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.896554 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.896697 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.896866 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.897047 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.897200 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.897438 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.897637 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.897786 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.897928 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.898085 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.898237 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.898390 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.898547 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.898716 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.898936 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.899120 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.899380 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.899559 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.899827 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.900060 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.900222 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.900366 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.900510 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.900659 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.900810 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.900989 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.901151 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.901295 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.901449 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.901592 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.901734 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.901734 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.902113 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.902270 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.902416 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.902558 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.902709 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.902867 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.903018 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.903160 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.903313 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.903456 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.903605 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.903758 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.903900 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.904051 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.904207 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.905329 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.905507 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.905738 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.905897 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.906042 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.906184 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.906345 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.906489 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.906631 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.906789 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.906934 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.907076 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.907226 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.907368 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.907598 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.908297 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.908459 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.908603 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.908767 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.909059 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.909220 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.909399 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.909643 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.909810 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.910071 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.910303 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.910471 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.910626 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.910777 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.910921 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.911064 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.911231 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.911388 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.911567 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.911716 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.911858 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.912000 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.912229 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.912392 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.912544 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.912696 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.912865 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.913015 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.913168 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.913403 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.913403 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.913722 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.913722 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.914013 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.914167 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.914312 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.914454 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.914620 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.914839 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.915112 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.915276 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.915420 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.915420 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.915730 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.915946 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.916095 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.916249 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.916400 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.916552 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.916732 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.916906 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.917063 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.917220 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.917371 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.917514 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.917775 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.917931 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.918075 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.918230 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.918376 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.918517 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.918666 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.918820 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.918971 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.919197 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.919347 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.919502 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.919682 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.919919 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.920096 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.920350 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.920589 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.920911 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.921078 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.921230 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.921393 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.921539 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.921681 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.921831 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.921982 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.922154 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.922391 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.922618 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.922783 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.922942 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.923606 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.923762 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.924439 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.924597 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.924759 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.924759 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.925256 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.925415 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.925571 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.925571 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.925866 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.926107 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.926257 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.926401 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.926553 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.926697 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.926859 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.927016 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.927159 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.927301 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.927443 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.927605 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.927775 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.927991 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.928150 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.928294 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.928444 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.928597 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.928750 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.928936 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.929094 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.929332 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.929482 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.929635 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.929790 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.929952 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.930186 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.930365 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.930627 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.930853 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.930853 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.931140 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.931140 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.931140 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.931140 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.931140 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.931820 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.931977 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.932128 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 01:29:33.932277 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.932520 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.932679 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.932849 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.933059 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.933460 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.933623 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.933768 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.933920 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.934064 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.934220 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.934363 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.934519 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.934670 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.934812 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.934962 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.935308 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.935475 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.935630 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.935773 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.935915 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.936084 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.936320 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.936471 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.936629 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.936773 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.936939 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.937083 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.937226 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.937386 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.937530 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.937684 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.937834 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.937995 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.938214 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.938389 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.938534 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.938677 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.939533 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.940124 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.940391 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.940563 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.940967 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.941144 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.941297 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.941457 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.941608 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.941768 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.942016 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.942170 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.942330 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.942330 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.942708 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.942872 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.943022 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.943172 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.943330 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.943488 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.943685 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.943841 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.943998 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.944161 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.944321 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.944479 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.944644 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.944794 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.944970 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.945136 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.945402 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.945638 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.945836 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.945992 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.946150 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.946346 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.946582 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.946741 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.946891 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.947040 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.947189 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.947351 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.947509 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.947659 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.947810 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.947967 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.948116 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.948362 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.948532 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.948532 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.948891 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.949051 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.949218 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.949377 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.949534 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.949684 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.949842 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.949991 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.950164 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.950407 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.950652 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.950846 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.951166 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.951335 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.951496 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.951654 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.951811 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.951970 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.952128 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.952278 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.952436 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.952596 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.952843 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.953030 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.953190 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.953354 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.953524 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.953682 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.953832 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.953990 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.954148 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.954314 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.954919 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.955092 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.955245 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.955412 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.955676 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.955921 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.956086 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.956245 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.956395 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.956571 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.956805 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.957001 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.957162 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.957322 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.957479 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.957629 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.957786 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.957786 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.958090 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.958247 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.958491 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.958650 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.958808 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.958959 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.959117 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.959418 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.959589 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.959750 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.959909 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.960068 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.960229 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.960398 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.960651 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.960931 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.961120 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.961530 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.961709 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.961865 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.962023 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.962184 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.962344 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.962495 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.962644 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.962830 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.963061 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.963300 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.963456 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.963614 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.963772 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.963930 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.964080 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.964243 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.964401 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.964553 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.964709 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.964918 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.965108 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.965286 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.965440 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.965591 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.965836 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.966086 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.966349 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.966524 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.966684 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.966921 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.967086 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.967237 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.967411 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.967563 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.967714 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.967862 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.968020 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.968178 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.968338 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.968507 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.968728 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.968951 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.969109 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.969270 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.969435 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.969604 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.969764 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.969923 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.970675 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.970947 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.971203 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.971539 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.971699 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.971852 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.972001 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.972160 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.972312 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.972469 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.972630 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.972788 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.972975 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.973228 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.973387 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.973537 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.973693 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.973844 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.973994 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.974158 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.974317 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.974467 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.974616 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.974776 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.974932 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.975162 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.976032 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.976299 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.976465 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.976716 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.977235 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.977415 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.977575 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.977736 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.977952 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.978109 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.978260 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.978417 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.978567 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.978745 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.978976 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.979132 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.979283 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.979432 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.979597 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.979754 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.979913 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.980081 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.980241 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.980399 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.980569 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.980727 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.981058 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.981245 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.981508 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.981763 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.982024 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.982188 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.982348 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.982510 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.982660 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.982809 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.982971 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.983132 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.983375 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.983541 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.983692 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.983851 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.984001 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.984158 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.984316 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.984475 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.984637 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.984802 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.984997 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.985150 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.985307 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.985458 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.986152 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.987037 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.987293 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.987453 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.987605 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.987756 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.987907 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.987907 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.988230 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.988381 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.988538 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.988992 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.989241 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.989398 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.989548 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.989698 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.989854 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.990004 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.990597 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.990788 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.990948 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.991132 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.991296 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.991447 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.991744 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.991975 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.992239 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.992396 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.992552 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.992705 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.992915 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.993073 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.993255 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.993499 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.993663 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.993830 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.993982 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.994131 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.994280 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.994428 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.994577 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.994735 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.994887 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.995036 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.995193 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.995369 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.995369 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.995677 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.995835 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.995986 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.996135 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.996294 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.996443 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.996604 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.996763 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.996976 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.997214 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.997457 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.997636 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.997796 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.997953 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.998104 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.998261 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.998418 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.998576 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.998734 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.998891 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.999042 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.999207 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.999436 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.999599 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.999766 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:33.999924 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.000075 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.000234 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.000392 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.000557 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.000557 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.000909 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.001066 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.001294 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.002133 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.002414 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.002587 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.002738 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.002738 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.003033 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.003194 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.003354 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.003523 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.003746 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.003910 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.004069 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.004229 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.004389 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.004554 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.004724 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.004906 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.005070 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.005231 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.005382 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.005537 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.005686 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.005842 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.006006 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.006164 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.006313 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.006470 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.006620 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.006779 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.006936 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.007086 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.007340 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.007581 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.007773 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.007937 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.008102 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.008261 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.008412 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.008561 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.008710 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.008937 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.009108 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.009266 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.009442 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.009663 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.009829 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.010086 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.010254 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.010405 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.010563 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.010723 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.010874 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.011034 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.011202 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.011361 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.011518 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.011518 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.011820 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.011969 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.012143 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.012543 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.012703 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.012883 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.013075 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.013241 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.013392 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.013560 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.013737 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.013960 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.014125 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.014275 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.014425 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.014583 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.014742 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.014894 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.015043 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.015199 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.015348 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.015515 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.015677 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.015838 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.015996 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.016147 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.016295 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.016457 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.016617 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.016766 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.017913 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.018154 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.018312 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.018477 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.018645 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.018794 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.018943 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.019100 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.019258 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.019419 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.019577 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.019823 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.019980 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.020131 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.020279 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.020438 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.020608 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.020928 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.021103 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.021264 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.021423 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.021591 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.021742 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.021891 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.022039 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.022187 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.022542 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.022787 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.022960 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.023126 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.023299 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.023450 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.023613 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.023764 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.023935 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.024162 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.024326 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.024484 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.024484 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.024785 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.024785 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.025095 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.025245 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.025424 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.025575 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.025731 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.025881 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.026029 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.026176 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.026340 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.026497 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.026647 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.026801 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.026950 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.027097 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.027269 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.027427 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.027667 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.027823 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.027982 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.028159 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.028392 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.028548 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.028705 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.028880 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.029038 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.029203 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.029355 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.029355 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.029659 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.029834 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.030061 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.030232 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.030390 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.030549 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.030700 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.030848 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.030996 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.031159 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.031321 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.031479 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.031641 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.031800 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.031950 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.032108 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.032266 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.032424 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.033370 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.033477 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.033566 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.033656 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.033735 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.033814 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.033814 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.033949 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.034028 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.034121 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.034208 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.034286 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.034370 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.034457 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.034553 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.034649 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.034739 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.034821 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.034915 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.034915 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.035079 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.035168 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.035257 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.035350 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.035441 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.035523 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.035604 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.035684 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.035771 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.035861 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.035943 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.036029 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.036110 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.036190 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.036270 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.036358 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.036447 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.036529 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.036623 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.036713 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.036803 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.036936 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.037029 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.037112 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.037192 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.037279 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.037369 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.037459 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.037542 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.037638 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.037730 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.037808 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.037909 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.038001 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.038001 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.038159 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.038239 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.038326 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.038416 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.038488 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.038555 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.038642 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.038730 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.038812 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.038902 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.038985 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.039065 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.039153 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.039235 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.039323 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.039406 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.039487 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.039567 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.039647 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.039726 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.039726 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.039877 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.039958 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.040045 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.040122 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.040191 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.040283 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.040372 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.040461 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.040551 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.040641 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.040723 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.040816 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.040930 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.041020 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.041102 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.041183 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.041271 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.041361 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.041443 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.041523 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.041610 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.041610 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.041772 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.041772 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.041930 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.042049 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.042142 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.042232 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.042327 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.042417 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.042499 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.042587 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.042675 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.042757 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.042851 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.042933 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.043013 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.043100 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.043181 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.043275 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.043364 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.043446 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.043527 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.043617 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.043699 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.043783 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.043863 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.043939 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.044008 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.044075 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.044150 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.044228 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.044312 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.044390 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.044479 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.044568 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.044651 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.044740 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.044846 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.044932 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.045024 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.045107 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.045198 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.045275 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.045353 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.045430 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.045518 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.045518 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.045680 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.045770 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.045851 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.045851 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.045851 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.045851 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.046148 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.046231 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.046311 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.046391 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.046477 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.046559 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.046647 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.046737 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.046819 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.046906 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.046986 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.047075 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.047156 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.047236 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.047315 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.047394 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.047482 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.047577 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.047659 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.047738 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.047821 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.047891 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.047959 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.048051 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.048134 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.048211 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.048309 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.048441 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.048516 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.048602 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.048680 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.048756 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.048850 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.048850 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.049236 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.049337 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.049422 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.049511 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.049593 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.049593 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.049760 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.049842 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.049923 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.050003 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.050090 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.050172 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.050257 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.050327 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.050416 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.050497 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.050497 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.050649 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.050738 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.050826 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.050915 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.051004 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.051086 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.051179 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.051261 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.051349 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.051437 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.051526 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.051608 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.051697 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.051787 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.051876 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.051964 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.052046 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.052134 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.052229 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.052360 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.052502 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.052596 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.052679 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.052679 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.052860 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.052946 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.053040 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.053124 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.053205 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.053299 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.053373 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.053461 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.053548 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.053548 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.053704 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.053794 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.053872 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.053949 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.054031 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.054107 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.054186 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.054263 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.054341 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.054411 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.054485 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.054485 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.054621 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.054712 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.054794 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.054874 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.054955 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.055042 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.055134 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.055224 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.055308 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.055396 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.055468 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.055535 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.055628 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.055710 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.055805 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.055889 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.055968 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.056128 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.056214 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.056294 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.056382 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.056471 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.056554 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.056647 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.056732 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.056813 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.056931 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.057022 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.057105 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.057196 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.057285 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.057285 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.057434 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.057514 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.057603 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.057692 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.057775 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.057856 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.057941 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.058012 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.058100 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.058439 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.058537 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.058627 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.058715 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.058807 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.058898 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.058981 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.059087 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.059181 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.059265 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.059335 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.059567 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.059661 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.059751 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.059843 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.059932 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.060023 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.060106 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.060186 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.060273 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.060350 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.060419 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.060558 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.060643 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.060724 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.060805 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.060996 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.061082 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.061173 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.061256 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.061337 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.061417 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.061498 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.061582 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.061662 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.061739 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.061821 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.061901 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.061981 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.062069 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.062152 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.062233 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.062314 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.062401 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.062490 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.062580 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.062820 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.063000 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.063140 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.063331 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.063454 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.063647 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.063875 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.064156 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.064237 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.064518 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.064607 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.064858 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.064965 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.065178 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.065268 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.065491 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.065592 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.065803 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.065964 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.066113 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.066205 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.066427 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.066527 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.066739 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.066838 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.067062 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.067151 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.067384 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.067488 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.067706 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.067796 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.068022 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.068110 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.068339 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.068438 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.068658 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.068749 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.068997 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.069090 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.069348 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.069447 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.069597 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 01:29:34.069718 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.069963 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.070279 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.070596 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.070911 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.071224 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.071581 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.071851 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.072165 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.072476 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.072786 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.073125 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.073440 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.073765 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.074098 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.074418 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.074734 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.075047 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.075365 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.075884 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.076199 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.076528 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.076875 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.077202 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.077519 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.077837 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.078164 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.078472 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.078779 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.079096 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.079945 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.080393 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.080722 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.081060 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.081368 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.081689 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.082002 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.082574 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.082927 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.083250 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.083580 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.083908 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.084228 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.084541 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.084889 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.085202 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.085512 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.085833 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.086147 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.086455 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.086764 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.087081 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.087393 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.087700 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.088012 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.088320 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.088648 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.088984 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.089301 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.089606 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.089921 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.091097 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.091422 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.091743 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.092060 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.092386 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.092697 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.093045 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.093358 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.093676 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.093988 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.094304 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.094614 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.094949 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.095960 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.096172 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.096445 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.096760 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.097114 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.097435 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.097751 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.098111 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.098436 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.099036 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.099379 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.100882 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.100882 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.100882 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.100882 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.101252 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.101327 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.101625 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.101940 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.102251 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.102563 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.102875 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.103188 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.103499 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.103812 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.104123 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.104432 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.104746 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.105084 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.105438 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.105876 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.106144 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.106393 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.106710 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.107025 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.107339 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.107650 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.107961 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.108279 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.108612 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.108952 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.109270 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.109705 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.110021 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.110342 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.110695 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.111010 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.111334 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.111744 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.112066 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.112390 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.112705 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.113062 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.113408 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.113739 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.114066 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.114373 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.114679 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.114984 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.115294 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.115627 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.116026 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.116268 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.116571 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.116917 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.117230 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.117553 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.117875 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.118198 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.118507 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.118841 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.119157 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.119466 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.119775 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.120086 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.120393 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.120717 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.121061 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.121386 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.121692 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.122016 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.122329 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.122648 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.122962 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.123271 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.123596 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.123905 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.124220 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.124530 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.124852 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.125178 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.125493 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.125818 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.126171 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.126714 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.127008 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.127366 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.127682 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.128030 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.128361 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 01:29:34.128609 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 01:29:34.182047 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_db.sqlalchemy.engines [None req-4f3e39f8-f6dc-4a83-8d35-6fe8b9fedf56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108755) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 01:29:34.240280 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_db.sqlalchemy.engines [None req-7208ca7f-1ee6-467f-ba84-4d2530163e16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108756) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 01:29:34.262453 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.context [None req-4f3e39f8-f6dc-4a83-8d35-6fe8b9fedf56 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2d291931-575f-426d-9dd3-f69ed6f115bd(cell1) {{(pid=108755) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 01:29:34.266682 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4f3e39f8-f6dc-4a83-8d35-6fe8b9fedf56 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:29:34.268668 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4f3e39f8-f6dc-4a83-8d35-6fe8b9fedf56 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:29:34.269514 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4f3e39f8-f6dc-4a83-8d35-6fe8b9fedf56 None None] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:29:34.273181 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4f3e39f8-f6dc-4a83-8d35-6fe8b9fedf56 None None] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:29:34.283616 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_db.sqlalchemy.engines [None req-4f3e39f8-f6dc-4a83-8d35-6fe8b9fedf56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108755) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 01:29:34.284572 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_db.sqlalchemy.engines [None req-4f3e39f8-f6dc-4a83-8d35-6fe8b9fedf56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108755) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 01:29:34.317948 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.context [None req-7208ca7f-1ee6-467f-ba84-4d2530163e16 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2d291931-575f-426d-9dd3-f69ed6f115bd(cell1) {{(pid=108756) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 01:29:34.322248 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7208ca7f-1ee6-467f-ba84-4d2530163e16 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:29:34.323751 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7208ca7f-1ee6-467f-ba84-4d2530163e16 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:29:34.324553 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7208ca7f-1ee6-467f-ba84-4d2530163e16 None None] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:29:34.328118 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7208ca7f-1ee6-467f-ba84-4d2530163e16 None None] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:29:34.338606 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_db.sqlalchemy.engines [None req-7208ca7f-1ee6-467f-ba84-4d2530163e16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108756) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 01:29:34.342206 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_db.sqlalchemy.engines [None req-7208ca7f-1ee6-467f-ba84-4d2530163e16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108756) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 01:29:34.547769 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_db.sqlalchemy.engines [None req-4f3e39f8-f6dc-4a83-8d35-6fe8b9fedf56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108755) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 01:29:34.597166 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_db.sqlalchemy.engines [None req-7208ca7f-1ee6-467f-ba84-4d2530163e16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108756) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 01:29:34.875988 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: WARNING keystonemiddleware.auth_token [None req-4f3e39f8-f6dc-4a83-8d35-6fe8b9fedf56 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 01:29:34.883253 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: WARNING keystonemiddleware.auth_token [None req-4f3e39f8-f6dc-4a83-8d35-6fe8b9fedf56 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 01:29:34.919204 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: WARNING keystonemiddleware.auth_token [None req-7208ca7f-1ee6-467f-ba84-4d2530163e16 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 01:29:34.926020 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: WARNING keystonemiddleware.auth_token [None req-7208ca7f-1ee6-467f-ba84-4d2530163e16 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 01:29:35.229303 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: WARNING keystonemiddleware.auth_token [None req-4f3e39f8-f6dc-4a83-8d35-6fe8b9fedf56 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 01:29:35.234449 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: WARNING keystonemiddleware.auth_token [None req-4f3e39f8-f6dc-4a83-8d35-6fe8b9fedf56 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 01:29:35.240412 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559b58fca9c0 pid: 108755 (default app) Aug 27 01:29:35.278893 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: WARNING keystonemiddleware.auth_token [None req-7208ca7f-1ee6-467f-ba84-4d2530163e16 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 01:29:35.284717 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: WARNING keystonemiddleware.auth_token [None req-7208ca7f-1ee6-467f-ba84-4d2530163e16 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 01:29:35.290167 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559b58fca9c0 pid: 108756 (default app) Aug 27 01:30:10.177649 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-1ccee223-64b2-448b-ad90-b90c73528f12 tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] Action: 'create', calling method: .version_select at 0x7ff215067ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-452099723"}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:30:12.243654 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-1ccee223-64b2-448b-ad90-b90c73528f12 tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.182537 Aug 27 01:30:12.244758 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1155 bytes} [Fri Aug 27 01:30:09 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 3185 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 27 01:30:12.258199 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-5032c711-bb33-4355-8475-3c0a01c4496f tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] Calling method '.version_select at 0x7ff214f34700>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:12.374013 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-5032c711-bb33-4355-8475-3c0a01c4496f tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/516fe746-18d3-459f-8a41-a4b85e724750" status: 200 len: 344 microversion: 2.1 time: 0.121195 Aug 27 01:30:12.379637 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 2/2] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Aug 27 01:30:12 2021] GET /compute/v2.1/os-volumes/516fe746-18d3-459f-8a41-a4b85e724750 => generated 344 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:30:12.624372 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-76b71886-01ea-4a5e-9398-df0368550823 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-140033651", "imageRef": "6660bea6-dee9-43b4-95ef-29b53e1a2b28", "flavorRef": "452", "networks": [{"uuid": "4b165d08-d478-4821-bbe5-bfe50564161b"}]}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:30:13.027002 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.network.neutron [None req-76b71886-01ea-4a5e-9398-df0368550823 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] validate_networks() for [('4b165d08-d478-4821-bbe5-bfe50564161b', None, None, None, None, None)] {{(pid=108756) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 01:30:13.387283 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-bfd70b8c-6dee-4766-adba-5f4d49367b7b tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] Calling method '.version_select at 0x7ff214f34e50>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:13.515005 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-bfd70b8c-6dee-4766-adba-5f4d49367b7b tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/516fe746-18d3-459f-8a41-a4b85e724750" status: 200 len: 344 microversion: 2.1 time: 0.131945 Aug 27 01:30:13.516194 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 3/3] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Aug 27 01:30:13 2021] GET /compute/v2.1/os-volumes/516fe746-18d3-459f-8a41-a4b85e724750 => generated 344 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:30:14.527390 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-841408b1-da3a-4c79-bd16-a6702d04a94f tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] Calling method '.version_select at 0x7ff214f4a0d0>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:14.560402 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-76b71886-01ea-4a5e-9398-df0368550823 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Flavor limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 01:30:14.560884 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-76b71886-01ea-4a5e-9398-df0368550823 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Image limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 01:30:14.561321 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-76b71886-01ea-4a5e-9398-df0368550823 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Flavor pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 01:30:14.561728 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-76b71886-01ea-4a5e-9398-df0368550823 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Image pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 01:30:14.562315 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-76b71886-01ea-4a5e-9398-df0368550823 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 01:30:14.592118 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-76b71886-01ea-4a5e-9398-df0368550823 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:14.592593 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-76b71886-01ea-4a5e-9398-df0368550823 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:14.593573 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-76b71886-01ea-4a5e-9398-df0368550823 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:14.597489 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-76b71886-01ea-4a5e-9398-df0368550823 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:14.640487 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-841408b1-da3a-4c79-bd16-a6702d04a94f tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/516fe746-18d3-459f-8a41-a4b85e724750" status: 200 len: 345 microversion: 2.1 time: 0.116317 Aug 27 01:30:14.643255 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 4/4] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Aug 27 01:30:14 2021] GET /compute/v2.1/os-volumes/516fe746-18d3-459f-8a41-a4b85e724750 => generated 345 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:30:14.662617 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-76b71886-01ea-4a5e-9398-df0368550823 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Getting quotas for project b8f4319d61634014a030eb7b9b741e92. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:30:14.663447 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4ea6d186-853e-45e0-a10b-72b38ceaee60 tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] Action: 'create', calling method: .version_select at 0x7ff214f4a9d0>, body: {"snapshot": {"volume_id": "516fe746-18d3-459f-8a41-a4b85e724750", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1562046964"}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:30:14.714707 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-76b71886-01ea-4a5e-9398-df0368550823 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Getting quotas for user 63916350d84642b0b2606341d71651f8 and project b8f4319d61634014a030eb7b9b741e92. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:30:14.731114 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-76b71886-01ea-4a5e-9398-df0368550823 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Going to run 1 instances... {{(pid=108756) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 01:30:14.744053 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-76b71886-01ea-4a5e-9398-df0368550823 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6660bea6-dee9-43b4-95ef-29b53e1a2b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 01:30:15.040213 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-76b71886-01ea-4a5e-9398-df0368550823 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.078778 Aug 27 01:30:15.048058 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 1/5] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Aug 27 01:30:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 3088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 01:30:15.065525 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-8f1572c3-ea0e-40ee-91b4-999510262543 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:15.066192 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-8f1572c3-ea0e-40ee-91b4-999510262543 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:15.319037 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-8f1572c3-ea0e-40ee-91b4-999510262543 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:15.340158 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-8f1572c3-ea0e-40ee-91b4-999510262543 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1214 microversion: 2.1 time: 0.290210 Aug 27 01:30:15.362049 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 2/6] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:15 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1214 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:15.536863 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4ea6d186-853e-45e0-a10b-72b38ceaee60 tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.883678 Aug 27 01:30:15.541437 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 5/7] 10.222.0.25 () {60 vars in 1162 bytes} [Fri Aug 27 01:30:14 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:30:15.553921 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-e9e85d40-9b55-4133-8434-0da9d3eddf8e tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] Calling method '.version_select at 0x7ff214652af0>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:15.814889 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-e9e85d40-9b55-4133-8434-0da9d3eddf8e tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/87d1d55b-9e00-45c6-89a6-9b73df88f23a" status: 200 len: 287 microversion: 2.1 time: 0.267018 Aug 27 01:30:15.817798 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 3/8] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Aug 27 01:30:15 2021] GET /compute/v2.1/os-snapshots/87d1d55b-9e00-45c6-89a6-9b73df88f23a => generated 287 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:30:15.826384 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-38929a32-d5cd-42a3-8cec-8756baa96bcc tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] Calling method '.version_select at 0x7ff214f4af70>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:15.905259 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-38929a32-d5cd-42a3-8cec-8756baa96bcc tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.082315 Aug 27 01:30:15.906438 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 6/9] 10.222.0.25 () {58 vars in 1140 bytes} [Fri Aug 27 01:30:15 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:30:15.916798 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-575aa16d-a1fc-4036-bc66-5b9420e00225 tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] Calling method '.version_select at 0x7ff21507faf0>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:16.013405 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-575aa16d-a1fc-4036-bc66-5b9420e00225 tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/87d1d55b-9e00-45c6-89a6-9b73df88f23a" status: 200 len: 287 microversion: 2.1 time: 0.100344 Aug 27 01:30:16.014492 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 7/10] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Aug 27 01:30:15 2021] GET /compute/v2.1/os-snapshots/87d1d55b-9e00-45c6-89a6-9b73df88f23a => generated 287 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:30:16.102210 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-f9b446b9-bf88-4e56-bc34-8e608434dde4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2064160928", "imageRef": "6660bea6-dee9-43b4-95ef-29b53e1a2b28", "flavorRef": "452", "networks": [{"uuid": "0794f498-7c79-4c04-9426-97a5145b6e4e"}]}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:30:16.239835 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.network.neutron [None req-f9b446b9-bf88-4e56-bc34-8e608434dde4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] validate_networks() for [('0794f498-7c79-4c04-9426-97a5145b6e4e', None, None, None, None, None)] {{(pid=108756) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 01:30:16.369270 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-ec7570c0-ce0c-49b0-a71f-b161f6d17c0c tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:16.370274 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-ec7570c0-ce0c-49b0-a71f-b161f6d17c0c tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:16.754780 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-ec7570c0-ce0c-49b0-a71f-b161f6d17c0c tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:16.781871 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-ec7570c0-ce0c-49b0-a71f-b161f6d17c0c tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1214 microversion: 2.1 time: 0.415270 Aug 27 01:30:16.782673 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 8/11] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:16 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1214 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:30:17.026089 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-808b3a81-9f9d-4c94-8436-4e2ea2801970 tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] Calling method '.version_select at 0x7ff214f4f040>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:17.080157 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-808b3a81-9f9d-4c94-8436-4e2ea2801970 tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/87d1d55b-9e00-45c6-89a6-9b73df88f23a" status: 200 len: 287 microversion: 2.1 time: 0.058192 Aug 27 01:30:17.080719 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 9/12] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Aug 27 01:30:17 2021] GET /compute/v2.1/os-snapshots/87d1d55b-9e00-45c6-89a6-9b73df88f23a => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:30:17.346501 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-f9b446b9-bf88-4e56-bc34-8e608434dde4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Flavor limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 01:30:17.346974 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-f9b446b9-bf88-4e56-bc34-8e608434dde4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Image limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 01:30:17.347854 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-f9b446b9-bf88-4e56-bc34-8e608434dde4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Flavor pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 01:30:17.348268 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-f9b446b9-bf88-4e56-bc34-8e608434dde4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Image pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 01:30:17.348717 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-f9b446b9-bf88-4e56-bc34-8e608434dde4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 01:30:17.367866 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f9b446b9-bf88-4e56-bc34-8e608434dde4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:17.368323 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f9b446b9-bf88-4e56-bc34-8e608434dde4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:17.369142 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f9b446b9-bf88-4e56-bc34-8e608434dde4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:17.369782 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f9b446b9-bf88-4e56-bc34-8e608434dde4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:17.399102 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-f9b446b9-bf88-4e56-bc34-8e608434dde4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Getting quotas for project 8c9439f7236d4228aea4ccc73e5d6c08. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:30:17.403815 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-f9b446b9-bf88-4e56-bc34-8e608434dde4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Getting quotas for user 589eca6a184e4505a0c0f97efe65892e and project 8c9439f7236d4228aea4ccc73e5d6c08. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:30:17.422220 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-f9b446b9-bf88-4e56-bc34-8e608434dde4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Going to run 1 instances... {{(pid=108756) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 01:30:17.426738 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-f9b446b9-bf88-4e56-bc34-8e608434dde4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6660bea6-dee9-43b4-95ef-29b53e1a2b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 01:30:17.573024 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-f9b446b9-bf88-4e56-bc34-8e608434dde4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.692048 Aug 27 01:30:17.576198 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 4/13] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Aug 27 01:30:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 1697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 01:30:17.592482 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-3bcaf58c-0a0d-47cf-b4cc-135e361a5c89 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:17.593214 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-3bcaf58c-0a0d-47cf-b4cc-135e361a5c89 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:17.687563 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-3bcaf58c-0a0d-47cf-b4cc-135e361a5c89 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:17.698629 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-3bcaf58c-0a0d-47cf-b4cc-135e361a5c89 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1218 microversion: 2.1 time: 0.112489 Aug 27 01:30:17.705204 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 10/14] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:17 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:17.809034 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c3521a91-bfa6-4b0e-9d5e-1bda8cedf25c tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:17.809965 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c3521a91-bfa6-4b0e-9d5e-1bda8cedf25c tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:17.829900 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c3521a91-bfa6-4b0e-9d5e-1bda8cedf25c tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:17.832848 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c3521a91-bfa6-4b0e-9d5e-1bda8cedf25c tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:17.835076 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c3521a91-bfa6-4b0e-9d5e-1bda8cedf25c tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:17.835729 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c3521a91-bfa6-4b0e-9d5e-1bda8cedf25c tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:18.068696 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-2067adfc-33e8-442a-9615-fdc90cae83a6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'create', calling method: .version_select at 0x7ff214e91790>, body: {"keypair": {"name": "tempest-keypair-913254760"}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:30:18.216578 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-2067adfc-33e8-442a-9615-fdc90cae83a6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Getting quotas for project 1d392d1b39ee49d1b87211d5c447f9dc. Resources: {'key_pairs'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:30:18.232705 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-2067adfc-33e8-442a-9615-fdc90cae83a6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Getting quotas for user fa605019ca5c40d897cb30c990710ff6 and project 1d392d1b39ee49d1b87211d5c447f9dc. Resources: {'key_pairs'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:30:18.257435 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c3521a91-bfa6-4b0e-9d5e-1bda8cedf25c tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:18.283753 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c3521a91-bfa6-4b0e-9d5e-1bda8cedf25c tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1218 microversion: 2.1 time: 0.483619 Aug 27 01:30:18.287580 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 5/15] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:17 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1218 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:18.300245 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-454299c0-ea47-471b-a057-c96aed2555c6 tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] Calling method '.version_select at 0x7ff214581790>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:18.364534 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-454299c0-ea47-471b-a057-c96aed2555c6 tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/87d1d55b-9e00-45c6-89a6-9b73df88f23a" status: 200 len: 287 microversion: 2.1 time: 0.075073 Aug 27 01:30:18.365871 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 6/16] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Aug 27 01:30:18 2021] GET /compute/v2.1/os-snapshots/87d1d55b-9e00-45c6-89a6-9b73df88f23a => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:30:18.720446 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-0c862dce-5c13-4188-b504-9f5b8a4bc153 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:18.721146 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-0c862dce-5c13-4188-b504-9f5b8a4bc153 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:18.746694 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-2067adfc-33e8-442a-9615-fdc90cae83a6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Getting quotas for project 1d392d1b39ee49d1b87211d5c447f9dc. Resources: {'key_pairs'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:30:18.759168 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-2067adfc-33e8-442a-9615-fdc90cae83a6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Getting quotas for user fa605019ca5c40d897cb30c990710ff6 and project 1d392d1b39ee49d1b87211d5c447f9dc. Resources: {'key_pairs'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:30:18.810728 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-2067adfc-33e8-442a-9615-fdc90cae83a6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.014720 Aug 27 01:30:18.811505 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 11/17] 10.222.0.25 () {60 vars in 1158 bytes} [Fri Aug 27 01:30:17 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:18.845555 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0c862dce-5c13-4188-b504-9f5b8a4bc153 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:18.854577 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-0c862dce-5c13-4188-b504-9f5b8a4bc153 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1218 microversion: 2.1 time: 0.136611 Aug 27 01:30:18.855688 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 7/18] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:18 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1218 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:19.310575 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-0e863b44-547f-4a69-8868-4f3aea943df7 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:19.318737 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-0e863b44-547f-4a69-8868-4f3aea943df7 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:19.344536 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0e863b44-547f-4a69-8868-4f3aea943df7 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:19.350259 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0e863b44-547f-4a69-8868-4f3aea943df7 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:19.350259 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0e863b44-547f-4a69-8868-4f3aea943df7 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:19.350259 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0e863b44-547f-4a69-8868-4f3aea943df7 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:19.379412 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-63c58243-ae73-4f74-8924-71196ca51ffb tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] Calling method '.version_select at 0x7ff214581c10>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:19.519752 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-63c58243-ae73-4f74-8924-71196ca51ffb tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/87d1d55b-9e00-45c6-89a6-9b73df88f23a" status: 200 len: 288 microversion: 2.1 time: 0.113305 Aug 27 01:30:19.519752 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 8/19] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Aug 27 01:30:19 2021] GET /compute/v2.1/os-snapshots/87d1d55b-9e00-45c6-89a6-9b73df88f23a => generated 288 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:30:19.524793 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-8c3e07e5-e3f2-4d57-a03c-130d76c012dc tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] Calling method '.version_select at 0x7ff2158bd310>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:19.622569 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-0e863b44-547f-4a69-8868-4f3aea943df7 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:19.650147 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-0e863b44-547f-4a69-8868-4f3aea943df7 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1218 microversion: 2.1 time: 0.344729 Aug 27 01:30:19.650147 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 12/20] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:19 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1218 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:19.877747 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-a012d4ff-d5c2-4a50-928b-dab5de3b1a48 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:19.879832 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-a012d4ff-d5c2-4a50-928b-dab5de3b1a48 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:19.900751 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-8c3e07e5-e3f2-4d57-a03c-130d76c012dc tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/87d1d55b-9e00-45c6-89a6-9b73df88f23a" status: 202 len: 0 microversion: 2.1 time: 0.379674 Aug 27 01:30:19.901616 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 9/21] 10.222.0.25 () {58 vars in 1254 bytes} [Fri Aug 27 01:30:19 2021] DELETE /compute/v2.1/os-snapshots/87d1d55b-9e00-45c6-89a6-9b73df88f23a => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:30:19.909692 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-da7a9c4c-3c62-40c5-b14f-97806fde26c7 tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] Calling method '.version_select at 0x7ff21457f0d0>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:19.910546 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a012d4ff-d5c2-4a50-928b-dab5de3b1a48 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:19.911991 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a012d4ff-d5c2-4a50-928b-dab5de3b1a48 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:19.914565 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a012d4ff-d5c2-4a50-928b-dab5de3b1a48 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:19.918943 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a012d4ff-d5c2-4a50-928b-dab5de3b1a48 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:20.037062 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-da7a9c4c-3c62-40c5-b14f-97806fde26c7 tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/87d1d55b-9e00-45c6-89a6-9b73df88f23a" status: 200 len: 287 microversion: 2.1 time: 0.131035 Aug 27 01:30:20.038272 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 10/22] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Aug 27 01:30:19 2021] GET /compute/v2.1/os-snapshots/87d1d55b-9e00-45c6-89a6-9b73df88f23a => generated 287 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:30:20.317034 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-a012d4ff-d5c2-4a50-928b-dab5de3b1a48 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:20.332224 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-a012d4ff-d5c2-4a50-928b-dab5de3b1a48 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1222 microversion: 2.1 time: 0.463597 Aug 27 01:30:20.345316 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 13/23] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:19 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1222 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:20.681499 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-72c03190-e60f-46cb-8cf9-575af80c2cd7 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:20.684415 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-72c03190-e60f-46cb-8cf9-575af80c2cd7 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:20.734296 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-72c03190-e60f-46cb-8cf9-575af80c2cd7 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:20.734296 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-72c03190-e60f-46cb-8cf9-575af80c2cd7 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:20.734296 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-72c03190-e60f-46cb-8cf9-575af80c2cd7 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:20.734296 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-72c03190-e60f-46cb-8cf9-575af80c2cd7 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:21.068652 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-72c03190-e60f-46cb-8cf9-575af80c2cd7 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:21.076386 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-72c03190-e60f-46cb-8cf9-575af80c2cd7 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1266 microversion: 2.1 time: 0.399201 Aug 27 01:30:21.078535 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 11/24] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:20 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1266 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:30:21.087422 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-335b7bec-69ad-4af4-ac26-5d5f2a5641cd tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] Calling method '.version_select at 0x7ff214581c10>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:21.175371 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.wsgi [None req-335b7bec-69ad-4af4-ac26-5d5f2a5641cd tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] HTTP exception thrown: Snapshot 87d1d55b-9e00-45c6-89a6-9b73df88f23a could not be found. Aug 27 01:30:21.176432 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-335b7bec-69ad-4af4-ac26-5d5f2a5641cd tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] Returning 404 to user: Snapshot 87d1d55b-9e00-45c6-89a6-9b73df88f23a could not be found. {{(pid=108756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:30:21.178633 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-335b7bec-69ad-4af4-ac26-5d5f2a5641cd tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/87d1d55b-9e00-45c6-89a6-9b73df88f23a" status: 404 len: 111 microversion: 2.1 time: 0.099123 Aug 27 01:30:21.179378 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 12/25] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Aug 27 01:30:21 2021] GET /compute/v2.1/os-snapshots/87d1d55b-9e00-45c6-89a6-9b73df88f23a => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:30:21.197941 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-d3bc77ba-0da2-43a3-85b6-58f3c4eba68b tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] Calling method '.version_select at 0x7ff2145f2940>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:21.321711 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-fadac3f8-ef88-407a-ac57-8bc4644acde4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'create', calling method: .version_select at 0x7ff21462b790>, body: {"keypair": {"name": "tempest-keypair-909256293"}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:30:21.448412 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-fadac3f8-ef88-407a-ac57-8bc4644acde4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Getting quotas for project 9cbe428e1f9c456087aa6ec677fe0330. Resources: {'key_pairs'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:30:21.474083 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-fadac3f8-ef88-407a-ac57-8bc4644acde4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Getting quotas for user 9032bdd7ffde4d3f9b500974a4c17c67 and project 9cbe428e1f9c456087aa6ec677fe0330. Resources: {'key_pairs'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:30:21.578992 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-d3bc77ba-0da2-43a3-85b6-58f3c4eba68b tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/516fe746-18d3-459f-8a41-a4b85e724750" status: 202 len: 0 microversion: 2.1 time: 0.393321 Aug 27 01:30:21.579587 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 13/26] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Aug 27 01:30:21 2021] DELETE /compute/v2.1/os-volumes/516fe746-18d3-459f-8a41-a4b85e724750 => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 01:30:21.585212 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-a9a732b9-68c6-4497-a5a2-d31deefd915a tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:21.586105 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-a9a732b9-68c6-4497-a5a2-d31deefd915a tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:21.613251 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a9a732b9-68c6-4497-a5a2-d31deefd915a tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:21.616260 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a9a732b9-68c6-4497-a5a2-d31deefd915a tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:21.617451 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a9a732b9-68c6-4497-a5a2-d31deefd915a tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:21.617937 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a9a732b9-68c6-4497-a5a2-d31deefd915a tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:21.922940 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-fadac3f8-ef88-407a-ac57-8bc4644acde4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Getting quotas for project 9cbe428e1f9c456087aa6ec677fe0330. Resources: {'key_pairs'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:30:21.949685 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-a9a732b9-68c6-4497-a5a2-d31deefd915a tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:21.972129 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-fadac3f8-ef88-407a-ac57-8bc4644acde4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Getting quotas for user 9032bdd7ffde4d3f9b500974a4c17c67 and project 9cbe428e1f9c456087aa6ec677fe0330. Resources: {'key_pairs'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:30:21.974927 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-a9a732b9-68c6-4497-a5a2-d31deefd915a tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1214 microversion: 2.1 time: 0.392112 Aug 27 01:30:21.978916 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 14/27] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:21 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1214 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:21.985606 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-71af63b4-6202-4889-8832-c78f060d79ac tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] Calling method '.version_select at 0x7ff214652af0>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:22.039105 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-fadac3f8-ef88-407a-ac57-8bc4644acde4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.068735 Aug 27 01:30:22.039105 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 14/28] 10.222.0.25 () {62 vars in 1199 bytes} [Fri Aug 27 01:30:20 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1073 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Aug 27 01:30:22.084992 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.wsgi [None req-71af63b4-6202-4889-8832-c78f060d79ac tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] HTTP exception thrown: Volume 516fe746-18d3-459f-8a41-a4b85e724750 could not be found. Aug 27 01:30:22.086320 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-71af63b4-6202-4889-8832-c78f060d79ac tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] Returning 404 to user: Volume 516fe746-18d3-459f-8a41-a4b85e724750 could not be found. {{(pid=108756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:30:22.089255 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-71af63b4-6202-4889-8832-c78f060d79ac tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/516fe746-18d3-459f-8a41-a4b85e724750" status: 404 len: 109 microversion: 2.1 time: 0.107568 Aug 27 01:30:22.090003 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 15/29] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Aug 27 01:30:21 2021] GET /compute/v2.1/os-volumes/516fe746-18d3-459f-8a41-a4b85e724750 => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:30:22.099436 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-72f73231-0cb8-40b0-ab1d-29c97e2d43dc tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:22.099436 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-72f73231-0cb8-40b0-ab1d-29c97e2d43dc tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:22.106260 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-72f73231-0cb8-40b0-ab1d-29c97e2d43dc tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:22.106713 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-72f73231-0cb8-40b0-ab1d-29c97e2d43dc tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:22.107469 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-72f73231-0cb8-40b0-ab1d-29c97e2d43dc tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:22.107913 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-72f73231-0cb8-40b0-ab1d-29c97e2d43dc tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:22.123323 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-a2a4c98c-14bb-4c53-91c9-a424d2975ef9 tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] Calling method '.version_select at 0x7ff2144d3a60>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:22.218749 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.wsgi [None req-a2a4c98c-14bb-4c53-91c9-a424d2975ef9 tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] HTTP exception thrown: Volume 516fe746-18d3-459f-8a41-a4b85e724750 could not be found. Aug 27 01:30:22.219353 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-a2a4c98c-14bb-4c53-91c9-a424d2975ef9 tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] Returning 404 to user: Volume 516fe746-18d3-459f-8a41-a4b85e724750 could not be found. {{(pid=108756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:30:22.220184 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-a2a4c98c-14bb-4c53-91c9-a424d2975ef9 tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/516fe746-18d3-459f-8a41-a4b85e724750" status: 404 len: 109 microversion: 2.1 time: 0.118791 Aug 27 01:30:22.229111 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 16/30] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Aug 27 01:30:22 2021] DELETE /compute/v2.1/os-volumes/516fe746-18d3-459f-8a41-a4b85e724750 => generated 109 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:30:22.234129 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-e13fa966-d4c3-4ddd-bae0-7527d1b3596b tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] Calling method '.version_select at 0x7ff2144d33a0>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:22.425067 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.wsgi [None req-e13fa966-d4c3-4ddd-bae0-7527d1b3596b tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] HTTP exception thrown: Volume 516fe746-18d3-459f-8a41-a4b85e724750 could not be found. Aug 27 01:30:22.425172 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-e13fa966-d4c3-4ddd-bae0-7527d1b3596b tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] Returning 404 to user: Volume 516fe746-18d3-459f-8a41-a4b85e724750 could not be found. {{(pid=108756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:30:22.425938 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-e13fa966-d4c3-4ddd-bae0-7527d1b3596b tempest-VolumesSnapshotsTestJSON-548134292 tempest-VolumesSnapshotsTestJSON-548134292-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/516fe746-18d3-459f-8a41-a4b85e724750" status: 404 len: 109 microversion: 2.1 time: 0.195545 Aug 27 01:30:22.428528 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 17/31] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Aug 27 01:30:22 2021] GET /compute/v2.1/os-volumes/516fe746-18d3-459f-8a41-a4b85e724750 => generated 109 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:30:22.458559 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-72f73231-0cb8-40b0-ab1d-29c97e2d43dc tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:22.470362 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-72f73231-0cb8-40b0-ab1d-29c97e2d43dc tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1284 microversion: 2.1 time: 0.380033 Aug 27 01:30:22.483761 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 15/32] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:22 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1284 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:22.997507 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-41d8f19d-ad30-464a-9be7-213d27cc8872 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:22.998128 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-41d8f19d-ad30-464a-9be7-213d27cc8872 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:23.013097 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-41d8f19d-ad30-464a-9be7-213d27cc8872 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:23.013602 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-41d8f19d-ad30-464a-9be7-213d27cc8872 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:23.014413 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-41d8f19d-ad30-464a-9be7-213d27cc8872 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:23.015692 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-41d8f19d-ad30-464a-9be7-213d27cc8872 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:23.535764 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-41d8f19d-ad30-464a-9be7-213d27cc8872 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:23.535764 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-41d8f19d-ad30-464a-9be7-213d27cc8872 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1278 microversion: 2.1 time: 0.215324 Aug 27 01:30:23.535764 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 18/33] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:22 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1278 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:23.543680 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-75cebfc0-f4a8-4643-aa94-6706b5de7d2b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:23.543680 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-75cebfc0-f4a8-4643-aa94-6706b5de7d2b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:23.543680 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-75cebfc0-f4a8-4643-aa94-6706b5de7d2b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:23.543680 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-75cebfc0-f4a8-4643-aa94-6706b5de7d2b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:23.549325 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-75cebfc0-f4a8-4643-aa94-6706b5de7d2b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:23.549325 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-75cebfc0-f4a8-4643-aa94-6706b5de7d2b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:23.738174 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-75cebfc0-f4a8-4643-aa94-6706b5de7d2b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:23.759678 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-75cebfc0-f4a8-4643-aa94-6706b5de7d2b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1272 microversion: 2.1 time: 0.275728 Aug 27 01:30:23.763203 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 16/34] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:23 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1272 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:30:24.223499 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-47c13a39-b4c5-409c-a7e4-efc7362177f1 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:24.226853 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-47c13a39-b4c5-409c-a7e4-efc7362177f1 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:24.237876 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-47c13a39-b4c5-409c-a7e4-efc7362177f1 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:24.240205 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-47c13a39-b4c5-409c-a7e4-efc7362177f1 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:24.241356 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-47c13a39-b4c5-409c-a7e4-efc7362177f1 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:24.243071 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-47c13a39-b4c5-409c-a7e4-efc7362177f1 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:24.366856 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-47c13a39-b4c5-409c-a7e4-efc7362177f1 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:24.386613 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-47c13a39-b4c5-409c-a7e4-efc7362177f1 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1276 microversion: 2.1 time: 0.163354 Aug 27 01:30:24.389294 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 19/35] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:24 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1276 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:24.789208 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-35b9404a-6263-4b89-95ad-4006d2eee6fb tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:24.790644 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-35b9404a-6263-4b89-95ad-4006d2eee6fb tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:24.805597 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-35b9404a-6263-4b89-95ad-4006d2eee6fb tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:24.807917 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-35b9404a-6263-4b89-95ad-4006d2eee6fb tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:24.816274 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-35b9404a-6263-4b89-95ad-4006d2eee6fb tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:24.830793 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-35b9404a-6263-4b89-95ad-4006d2eee6fb tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:25.303909 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-35b9404a-6263-4b89-95ad-4006d2eee6fb tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:25.326402 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-35b9404a-6263-4b89-95ad-4006d2eee6fb tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1272 microversion: 2.1 time: 0.528058 Aug 27 01:30:25.345188 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 17/36] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:24 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1272 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:25.403585 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ef599731-f308-4512-8705-7aad37fedb99 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:25.404430 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-ef599731-f308-4512-8705-7aad37fedb99 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:25.427299 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ef599731-f308-4512-8705-7aad37fedb99 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:25.434324 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ef599731-f308-4512-8705-7aad37fedb99 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:25.438106 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ef599731-f308-4512-8705-7aad37fedb99 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:25.443927 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ef599731-f308-4512-8705-7aad37fedb99 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:26.027235 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ef599731-f308-4512-8705-7aad37fedb99 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:26.035525 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-ef599731-f308-4512-8705-7aad37fedb99 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1276 microversion: 2.1 time: 0.635746 Aug 27 01:30:26.040130 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 20/37] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:25 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1276 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:26.344063 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-33aec37d-926b-4bb7-9b2c-f7357ff7b98b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:26.346409 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-33aec37d-926b-4bb7-9b2c-f7357ff7b98b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:26.362623 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-33aec37d-926b-4bb7-9b2c-f7357ff7b98b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:26.363925 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-33aec37d-926b-4bb7-9b2c-f7357ff7b98b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:26.367259 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-33aec37d-926b-4bb7-9b2c-f7357ff7b98b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:26.369374 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-33aec37d-926b-4bb7-9b2c-f7357ff7b98b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:26.770300 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-33aec37d-926b-4bb7-9b2c-f7357ff7b98b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:26.778108 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-33aec37d-926b-4bb7-9b2c-f7357ff7b98b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1272 microversion: 2.1 time: 0.438386 Aug 27 01:30:26.796993 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 18/38] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:26 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1272 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:27.056508 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-3e9d4624-dc4e-453f-8878-d3c42ced6e52 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:27.057961 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-3e9d4624-dc4e-453f-8878-d3c42ced6e52 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:27.065546 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3e9d4624-dc4e-453f-8878-d3c42ced6e52 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:27.071647 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3e9d4624-dc4e-453f-8878-d3c42ced6e52 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:27.072482 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3e9d4624-dc4e-453f-8878-d3c42ced6e52 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:27.072958 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3e9d4624-dc4e-453f-8878-d3c42ced6e52 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:27.806155 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-3bba1da6-6093-4076-b85d-103a31c3d795 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:27.806155 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-3bba1da6-6093-4076-b85d-103a31c3d795 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:27.816063 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3bba1da6-6093-4076-b85d-103a31c3d795 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:27.826247 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3bba1da6-6093-4076-b85d-103a31c3d795 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:27.827810 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3bba1da6-6093-4076-b85d-103a31c3d795 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:27.828549 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3bba1da6-6093-4076-b85d-103a31c3d795 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:28.299070 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-3e9d4624-dc4e-453f-8878-d3c42ced6e52 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:28.332616 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-3e9d4624-dc4e-453f-8878-d3c42ced6e52 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 1.275349 Aug 27 01:30:28.334594 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 21/39] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:27 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:28.352497 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-3bba1da6-6093-4076-b85d-103a31c3d795 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:28.361100 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-3bba1da6-6093-4076-b85d-103a31c3d795 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.562825 Aug 27 01:30:28.369422 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 19/40] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:27 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:30:29.217351 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-576fca58-4aa3-4826-bf61-494a6b24ddd3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-742622545", "imageRef": "6660bea6-dee9-43b4-95ef-29b53e1a2b28", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6cba5cc2-c26d-402b-a305-3f91c04ec99b"}], "security_groups": [{"name": "tempest-securitygroup--1074132185"}], "key_name": "tempest-keypair-913254760", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:30:29.351433 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-c227b83f-91bf-4a7f-92d3-9cbf7d640d12 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:29.353284 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-c227b83f-91bf-4a7f-92d3-9cbf7d640d12 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:29.364388 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c227b83f-91bf-4a7f-92d3-9cbf7d640d12 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:29.366954 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c227b83f-91bf-4a7f-92d3-9cbf7d640d12 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:29.369974 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c227b83f-91bf-4a7f-92d3-9cbf7d640d12 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:29.370568 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c227b83f-91bf-4a7f-92d3-9cbf7d640d12 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:29.527837 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.network.neutron [None req-576fca58-4aa3-4826-bf61-494a6b24ddd3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] validate_networks() for [('6cba5cc2-c26d-402b-a305-3f91c04ec99b', None, None, None, None, None)] {{(pid=108756) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 01:30:29.852148 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-c227b83f-91bf-4a7f-92d3-9cbf7d640d12 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:29.852148 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-c227b83f-91bf-4a7f-92d3-9cbf7d640d12 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 0.365995 Aug 27 01:30:29.852148 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 20/41] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:29 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:30:29.852148 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-8965e9fc-261d-4774-81aa-9b550fb004c9 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:29.853517 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-8965e9fc-261d-4774-81aa-9b550fb004c9 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:29.853517 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8965e9fc-261d-4774-81aa-9b550fb004c9 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:29.853517 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8965e9fc-261d-4774-81aa-9b550fb004c9 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:29.853517 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8965e9fc-261d-4774-81aa-9b550fb004c9 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:29.854286 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8965e9fc-261d-4774-81aa-9b550fb004c9 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:30.308888 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-576fca58-4aa3-4826-bf61-494a6b24ddd3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Flavor limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 01:30:30.309531 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-576fca58-4aa3-4826-bf61-494a6b24ddd3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Image limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 01:30:30.310210 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-576fca58-4aa3-4826-bf61-494a6b24ddd3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Flavor pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 01:30:30.310773 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-576fca58-4aa3-4826-bf61-494a6b24ddd3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Image pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 01:30:30.311334 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-576fca58-4aa3-4826-bf61-494a6b24ddd3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 01:30:30.323092 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-576fca58-4aa3-4826-bf61-494a6b24ddd3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:30.323547 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-576fca58-4aa3-4826-bf61-494a6b24ddd3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:30.325074 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-576fca58-4aa3-4826-bf61-494a6b24ddd3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:30.325667 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-576fca58-4aa3-4826-bf61-494a6b24ddd3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:30.345413 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-576fca58-4aa3-4826-bf61-494a6b24ddd3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Getting quotas for project 1d392d1b39ee49d1b87211d5c447f9dc. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:30:30.350050 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-576fca58-4aa3-4826-bf61-494a6b24ddd3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Getting quotas for user fa605019ca5c40d897cb30c990710ff6 and project 1d392d1b39ee49d1b87211d5c447f9dc. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:30:30.372551 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-576fca58-4aa3-4826-bf61-494a6b24ddd3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Going to run 1 instances... {{(pid=108756) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 01:30:30.375519 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-576fca58-4aa3-4826-bf61-494a6b24ddd3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6660bea6-dee9-43b4-95ef-29b53e1a2b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 01:30:30.446445 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-8965e9fc-261d-4774-81aa-9b550fb004c9 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:30.463288 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-8965e9fc-261d-4774-81aa-9b550fb004c9 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.748938 Aug 27 01:30:30.464455 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 21/42] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:29 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:30.471532 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-cf12c26b-1f60-41ea-9d79-6f065ed26e1b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1719476808", "imageRef": "6660bea6-dee9-43b4-95ef-29b53e1a2b28", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c8689e3-4506-47c0-a652-97ed18836189"}], "security_groups": [{"name": "tempest-securitygroup--945628615"}], "key_name": "tempest-keypair-909256293", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:30:30.878806 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-576fca58-4aa3-4826-bf61-494a6b24ddd3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.666673 Aug 27 01:30:30.883337 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 22/43] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Aug 27 01:30:29 2021] POST /compute/v2.1/servers => generated 402 bytes in 1672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 01:30:31.353788 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.network.neutron [None req-cf12c26b-1f60-41ea-9d79-6f065ed26e1b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] validate_networks() for [('5c8689e3-4506-47c0-a652-97ed18836189', None, None, None, None, None)] {{(pid=108755) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 01:30:31.682350 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-04e85aef-de8e-4886-abd3-8f6f47e63064 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-467755183", "imageRef": "6660bea6-dee9-43b4-95ef-29b53e1a2b28", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b44490e8-3c86-4803-b813-6cfe1338f3e9"}]}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:30:31.852308 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.network.neutron [None req-04e85aef-de8e-4886-abd3-8f6f47e63064 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] validate_networks() for [('b44490e8-3c86-4803-b813-6cfe1338f3e9', None, None, None, None, None)] {{(pid=108756) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 01:30:33.049347 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-04e85aef-de8e-4886-abd3-8f6f47e63064 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Flavor limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 01:30:33.050542 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-04e85aef-de8e-4886-abd3-8f6f47e63064 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Image limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 01:30:33.051173 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-04e85aef-de8e-4886-abd3-8f6f47e63064 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Flavor pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 01:30:33.051716 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-04e85aef-de8e-4886-abd3-8f6f47e63064 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Image pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 01:30:33.052367 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-04e85aef-de8e-4886-abd3-8f6f47e63064 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 01:30:33.065065 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-04e85aef-de8e-4886-abd3-8f6f47e63064 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:33.070406 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-04e85aef-de8e-4886-abd3-8f6f47e63064 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:33.070406 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-04e85aef-de8e-4886-abd3-8f6f47e63064 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:33.070406 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-04e85aef-de8e-4886-abd3-8f6f47e63064 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:33.122941 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-04e85aef-de8e-4886-abd3-8f6f47e63064 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Getting quotas for project cc3b4bb0756249d19606e34fca91d4d5. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:30:33.127696 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-04e85aef-de8e-4886-abd3-8f6f47e63064 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Getting quotas for user 5952a90abc5042f48c9caecd82a0c74a and project cc3b4bb0756249d19606e34fca91d4d5. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:30:33.143723 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-04e85aef-de8e-4886-abd3-8f6f47e63064 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Going to run 1 instances... {{(pid=108756) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 01:30:33.146615 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-04e85aef-de8e-4886-abd3-8f6f47e63064 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6660bea6-dee9-43b4-95ef-29b53e1a2b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 01:30:33.319063 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-04e85aef-de8e-4886-abd3-8f6f47e63064 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.432141 Aug 27 01:30:33.322959 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Aug 27 01:30:30 2021] POST /compute/v2.1/servers => generated 383 bytes in 2439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 01:30:33.358851 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-037c582d-599d-43e8-989d-18c690188922 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:33.362913 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-037c582d-599d-43e8-989d-18c690188922 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:33.384323 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-037c582d-599d-43e8-989d-18c690188922 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:33.384783 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-037c582d-599d-43e8-989d-18c690188922 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:33.386442 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-037c582d-599d-43e8-989d-18c690188922 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:33.387045 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-037c582d-599d-43e8-989d-18c690188922 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:33.664086 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-037c582d-599d-43e8-989d-18c690188922 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:33.674108 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-037c582d-599d-43e8-989d-18c690188922 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 0.349137 Aug 27 01:30:33.677352 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 24/45] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:33 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:33.680752 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.virt.hardware [None req-cf12c26b-1f60-41ea-9d79-6f065ed26e1b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Flavor limits 0:0:0 {{(pid=108755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 01:30:33.685429 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.virt.hardware [None req-cf12c26b-1f60-41ea-9d79-6f065ed26e1b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Image limits 0:0:0 {{(pid=108755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 01:30:33.685429 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.virt.hardware [None req-cf12c26b-1f60-41ea-9d79-6f065ed26e1b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Flavor pref 0:0:0 {{(pid=108755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 01:30:33.685429 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.virt.hardware [None req-cf12c26b-1f60-41ea-9d79-6f065ed26e1b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Image pref 0:0:0 {{(pid=108755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 01:30:33.685429 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.virt.hardware [None req-cf12c26b-1f60-41ea-9d79-6f065ed26e1b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 01:30:33.699720 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-cf4bb51f-7639-4a26-bce3-db6fa9301921 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:33.704507 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-cf4bb51f-7639-4a26-bce3-db6fa9301921 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:33.722140 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-cf12c26b-1f60-41ea-9d79-6f065ed26e1b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:33.722691 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-cf12c26b-1f60-41ea-9d79-6f065ed26e1b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:33.723633 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-cf12c26b-1f60-41ea-9d79-6f065ed26e1b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:33.724068 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-cf12c26b-1f60-41ea-9d79-6f065ed26e1b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:33.739060 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cf4bb51f-7639-4a26-bce3-db6fa9301921 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:33.739060 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cf4bb51f-7639-4a26-bce3-db6fa9301921 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:33.739060 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cf4bb51f-7639-4a26-bce3-db6fa9301921 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:33.739060 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cf4bb51f-7639-4a26-bce3-db6fa9301921 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:33.806007 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-cf12c26b-1f60-41ea-9d79-6f065ed26e1b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Getting quotas for project 9cbe428e1f9c456087aa6ec677fe0330. Resources: {'ram', 'instances', 'cores'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:30:33.835015 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-cf12c26b-1f60-41ea-9d79-6f065ed26e1b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Getting quotas for user 9032bdd7ffde4d3f9b500974a4c17c67 and project 9cbe428e1f9c456087aa6ec677fe0330. Resources: {'ram', 'instances', 'cores'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:30:33.856213 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-cf12c26b-1f60-41ea-9d79-6f065ed26e1b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Going to run 1 instances... {{(pid=108755) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 01:30:33.860325 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-cf12c26b-1f60-41ea-9d79-6f065ed26e1b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6660bea6-dee9-43b4-95ef-29b53e1a2b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 01:30:33.918939 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-cf4bb51f-7639-4a26-bce3-db6fa9301921 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:33.927527 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-cf4bb51f-7639-4a26-bce3-db6fa9301921 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1288 microversion: 2.1 time: 0.248682 Aug 27 01:30:33.936239 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 25/46] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:33 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1288 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:33.954413 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-94c14f17-a898-48fc-b654-8a1eba3c0845 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:33.955248 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-94c14f17-a898-48fc-b654-8a1eba3c0845 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:33.968356 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-94c14f17-a898-48fc-b654-8a1eba3c0845 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:33.968982 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-94c14f17-a898-48fc-b654-8a1eba3c0845 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:33.969656 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-94c14f17-a898-48fc-b654-8a1eba3c0845 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:33.970087 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-94c14f17-a898-48fc-b654-8a1eba3c0845 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:34.264202 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-cf12c26b-1f60-41ea-9d79-6f065ed26e1b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.798261 Aug 27 01:30:34.270476 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 22/47] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Aug 27 01:30:30 2021] POST /compute/v2.1/servers => generated 401 bytes in 3805 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 01:30:34.296160 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-df0e464e-1181-4a64-8d7f-623d6f417189 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:34.303521 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-df0e464e-1181-4a64-8d7f-623d6f417189 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:34.318502 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-94c14f17-a898-48fc-b654-8a1eba3c0845 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:34.331555 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-94c14f17-a898-48fc-b654-8a1eba3c0845 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.389788 Aug 27 01:30:34.332316 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 26/48] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:33 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:34.704441 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-df0e464e-1181-4a64-8d7f-623d6f417189 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:34.728309 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-df0e464e-1181-4a64-8d7f-623d6f417189 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1221 microversion: 2.1 time: 0.444970 Aug 27 01:30:34.728309 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 23/49] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:34 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1221 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:34.753557 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-7f245c5e-adde-4863-b2e0-74c544dcd3ec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:34.754975 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-7f245c5e-adde-4863-b2e0-74c544dcd3ec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:34.784269 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-a607e52c-529e-4ae2-9b77-3f27de5190b0 req-d98e756b-4c09-470a-a24a-d1a421b994d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f70206d1-bfb4-4b0a-9215-72f8e06a7c66", "tag": "c1d36e2a-bbeb-40d1-84c2-dacc81e5fe3e"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:30:34.787034 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:30:34.787034 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:30:34.831601 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-a607e52c-529e-4ae2-9b77-3f27de5190b0 req-d98e756b-4c09-470a-a24a-d1a421b994d7 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:34.832047 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-a607e52c-529e-4ae2-9b77-3f27de5190b0 req-d98e756b-4c09-470a-a24a-d1a421b994d7 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:34.926301 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-a607e52c-529e-4ae2-9b77-3f27de5190b0 req-d98e756b-4c09-470a-a24a-d1a421b994d7 service nova] Creating event network-changed:c1d36e2a-bbeb-40d1-84c2-dacc81e5fe3e for instance f70206d1-bfb4-4b0a-9215-72f8e06a7c66 on hv-cinder-75916 Aug 27 01:30:34.927304 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-a607e52c-529e-4ae2-9b77-3f27de5190b0 req-d98e756b-4c09-470a-a24a-d1a421b994d7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=108756) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 27 01:30:34.930046 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c2e9b881-819c-44d5-941e-656934ccb5a5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:34.932935 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c2e9b881-819c-44d5-941e-656934ccb5a5 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:34.932935 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c2e9b881-819c-44d5-941e-656934ccb5a5 None None] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:34.934664 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c2e9b881-819c-44d5-941e-656934ccb5a5 None None] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:34.951204 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-7f245c5e-adde-4863-b2e0-74c544dcd3ec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:34.969344 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-7f245c5e-adde-4863-b2e0-74c544dcd3ec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:34.977882 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-7f245c5e-adde-4863-b2e0-74c544dcd3ec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:34.980257 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-7f245c5e-adde-4863-b2e0-74c544dcd3ec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1281 microversion: 2.20 time: 0.255141 Aug 27 01:30:34.984965 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.compute.rpcapi [None req-c2e9b881-819c-44d5-941e-656934ccb5a5 None None] Automatically selected compute RPC version 6.0 from minimum service version 57 Aug 27 01:30:34.988568 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 24/50] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:30:34 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1281 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:30:35.001955 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c2e9b881-819c-44d5-941e-656934ccb5a5 None None] Releasing lock "compute-rpcapi-router" {{(pid=108756) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 27 01:30:35.013505 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b9b70a3e-20b7-4b78-ab41-178b0edf7063 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:35.018614 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b9b70a3e-20b7-4b78-ab41-178b0edf7063 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:35.060772 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b9b70a3e-20b7-4b78-ab41-178b0edf7063 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:35.065133 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b9b70a3e-20b7-4b78-ab41-178b0edf7063 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:35.067785 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b9b70a3e-20b7-4b78-ab41-178b0edf7063 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:35.067785 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b9b70a3e-20b7-4b78-ab41-178b0edf7063 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:35.095390 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c2e9b881-819c-44d5-941e-656934ccb5a5 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.759674 Aug 27 01:30:35.096507 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 27/51] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:30:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:30:35.104341 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-e2a90d2a-a647-4109-9803-de1425d2a3b6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:35.106726 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-e2a90d2a-a647-4109-9803-de1425d2a3b6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:35.120684 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e2a90d2a-a647-4109-9803-de1425d2a3b6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:35.121953 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e2a90d2a-a647-4109-9803-de1425d2a3b6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:35.124072 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e2a90d2a-a647-4109-9803-de1425d2a3b6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:35.125112 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e2a90d2a-a647-4109-9803-de1425d2a3b6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:35.451244 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-e2a90d2a-a647-4109-9803-de1425d2a3b6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:35.681018 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-e2a90d2a-a647-4109-9803-de1425d2a3b6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1296 microversion: 2.1 time: 0.379885 Aug 27 01:30:35.681018 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 28/52] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:35 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1296 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:35.681018 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-d46456dd-1a74-4846-ac15-4f9b4d1035f0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1977243150", "imageRef": "6660bea6-dee9-43b4-95ef-29b53e1a2b28", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b44490e8-3c86-4803-b813-6cfe1338f3e9"}]}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:30:35.681018 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.network.neutron [None req-d46456dd-1a74-4846-ac15-4f9b4d1035f0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] validate_networks() for [('b44490e8-3c86-4803-b813-6cfe1338f3e9', None, None, None, None, None)] {{(pid=108756) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 01:30:35.989658 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-b9b70a3e-20b7-4b78-ab41-178b0edf7063 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:36.011542 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b9b70a3e-20b7-4b78-ab41-178b0edf7063 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 1.011014 Aug 27 01:30:36.014672 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 25/53] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:34 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:36.027324 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-60e4962c-6c1c-4278-90f5-cde770410e19 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:36.034510 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-60e4962c-6c1c-4278-90f5-cde770410e19 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:36.051768 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-60e4962c-6c1c-4278-90f5-cde770410e19 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:36.053242 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-60e4962c-6c1c-4278-90f5-cde770410e19 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:36.057065 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-60e4962c-6c1c-4278-90f5-cde770410e19 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:36.057863 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-60e4962c-6c1c-4278-90f5-cde770410e19 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:36.417872 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-60e4962c-6c1c-4278-90f5-cde770410e19 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:36.427271 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-60e4962c-6c1c-4278-90f5-cde770410e19 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.411116 Aug 27 01:30:36.430781 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 26/54] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:36 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:36.437333 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-7d52e8f2-1b54-452f-a53f-9f54b37b9daf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:36.441146 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-7d52e8f2-1b54-452f-a53f-9f54b37b9daf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:36.448685 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7d52e8f2-1b54-452f-a53f-9f54b37b9daf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:36.449639 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7d52e8f2-1b54-452f-a53f-9f54b37b9daf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:36.450776 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7d52e8f2-1b54-452f-a53f-9f54b37b9daf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:36.451451 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7d52e8f2-1b54-452f-a53f-9f54b37b9daf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:36.567681 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-7d52e8f2-1b54-452f-a53f-9f54b37b9daf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:36.580683 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-7d52e8f2-1b54-452f-a53f-9f54b37b9daf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:36.582894 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-7d52e8f2-1b54-452f-a53f-9f54b37b9daf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:36.584238 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-7d52e8f2-1b54-452f-a53f-9f54b37b9daf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1285 microversion: 2.20 time: 0.151019 Aug 27 01:30:36.585610 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 27/55] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:30:36 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:30:36.608433 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d2601df3-d8f5-40df-bfbc-9c789178c275 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:36.612695 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d2601df3-d8f5-40df-bfbc-9c789178c275 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:36.633122 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d2601df3-d8f5-40df-bfbc-9c789178c275 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:36.633871 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d2601df3-d8f5-40df-bfbc-9c789178c275 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:36.649094 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d2601df3-d8f5-40df-bfbc-9c789178c275 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:36.649757 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d2601df3-d8f5-40df-bfbc-9c789178c275 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:36.814405 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d2601df3-d8f5-40df-bfbc-9c789178c275 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:36.814405 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d2601df3-d8f5-40df-bfbc-9c789178c275 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1294 microversion: 2.1 time: 0.219108 Aug 27 01:30:36.814405 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 28/56] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:36 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1294 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:36.910411 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-d46456dd-1a74-4846-ac15-4f9b4d1035f0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Flavor limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 01:30:36.911623 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-d46456dd-1a74-4846-ac15-4f9b4d1035f0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Image limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 01:30:36.912402 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-d46456dd-1a74-4846-ac15-4f9b4d1035f0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Flavor pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 01:30:36.912686 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-d46456dd-1a74-4846-ac15-4f9b4d1035f0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Image pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 01:30:36.914738 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-d46456dd-1a74-4846-ac15-4f9b4d1035f0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 01:30:36.933361 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d46456dd-1a74-4846-ac15-4f9b4d1035f0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:36.933859 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d46456dd-1a74-4846-ac15-4f9b4d1035f0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:36.938094 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d46456dd-1a74-4846-ac15-4f9b4d1035f0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:36.938821 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d46456dd-1a74-4846-ac15-4f9b4d1035f0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:37.034738 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-f92ad814-f5cc-4973-aa32-8ea5f31bfed2 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:37.035732 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-f92ad814-f5cc-4973-aa32-8ea5f31bfed2 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:37.049562 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f92ad814-f5cc-4973-aa32-8ea5f31bfed2 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:37.050016 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f92ad814-f5cc-4973-aa32-8ea5f31bfed2 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:37.053362 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f92ad814-f5cc-4973-aa32-8ea5f31bfed2 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:37.055670 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f92ad814-f5cc-4973-aa32-8ea5f31bfed2 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:37.072250 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-d46456dd-1a74-4846-ac15-4f9b4d1035f0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Getting quotas for project cc3b4bb0756249d19606e34fca91d4d5. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:30:37.084732 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-d46456dd-1a74-4846-ac15-4f9b4d1035f0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Getting quotas for user 5952a90abc5042f48c9caecd82a0c74a and project cc3b4bb0756249d19606e34fca91d4d5. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:30:37.143686 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-d46456dd-1a74-4846-ac15-4f9b4d1035f0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Going to run 1 instances... {{(pid=108756) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 01:30:37.147650 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-d46456dd-1a74-4846-ac15-4f9b4d1035f0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6660bea6-dee9-43b4-95ef-29b53e1a2b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 01:30:37.327548 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-d46456dd-1a74-4846-ac15-4f9b4d1035f0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.836850 Aug 27 01:30:37.330272 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 29/57] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Aug 27 01:30:35 2021] POST /compute/v2.1/servers => generated 383 bytes in 1844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 01:30:37.346117 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-393561f1-233f-4260-9ebc-eee7d6171e0b req-e2094b0c-648c-4a8c-94d6-7817fc853f23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b401b16-f181-45c2-99c7-73e06eb28974", "tag": "2f74abdb-9f0c-4344-b541-0b15dc2c35bc"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:30:37.377216 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:30:37.377216 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:30:37.415463 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-f92ad814-f5cc-4973-aa32-8ea5f31bfed2 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:37.433215 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-393561f1-233f-4260-9ebc-eee7d6171e0b req-e2094b0c-648c-4a8c-94d6-7817fc853f23 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:37.433955 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-f92ad814-f5cc-4973-aa32-8ea5f31bfed2 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 0.403882 Aug 27 01:30:37.434278 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-393561f1-233f-4260-9ebc-eee7d6171e0b req-e2094b0c-648c-4a8c-94d6-7817fc853f23 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:37.435686 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 29/58] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:37 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:37.446799 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-87fa80bf-0cc8-4746-aef6-ca168931b45a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:37.447913 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-87fa80bf-0cc8-4746-aef6-ca168931b45a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:37.462043 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-393561f1-233f-4260-9ebc-eee7d6171e0b req-e2094b0c-648c-4a8c-94d6-7817fc853f23 service nova] Creating event network-changed:2f74abdb-9f0c-4344-b541-0b15dc2c35bc for instance 9b401b16-f181-45c2-99c7-73e06eb28974 on hv-cinder-75916 Aug 27 01:30:37.470453 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-393561f1-233f-4260-9ebc-eee7d6171e0b req-e2094b0c-648c-4a8c-94d6-7817fc853f23 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138728 Aug 27 01:30:37.473749 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 30/59] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:30:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:30:37.485703 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-01491023-3a1b-42c7-81a9-a0fefa291fd2 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:37.491850 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-01491023-3a1b-42c7-81a9-a0fefa291fd2 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:37.508992 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-01491023-3a1b-42c7-81a9-a0fefa291fd2 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:37.509773 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-01491023-3a1b-42c7-81a9-a0fefa291fd2 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:37.513920 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-01491023-3a1b-42c7-81a9-a0fefa291fd2 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:37.518528 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-01491023-3a1b-42c7-81a9-a0fefa291fd2 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:37.604163 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-87fa80bf-0cc8-4746-aef6-ca168931b45a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:37.617617 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-87fa80bf-0cc8-4746-aef6-ca168931b45a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1222 microversion: 2.1 time: 0.179961 Aug 27 01:30:37.625403 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 30/60] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:37 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1222 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:37.632917 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d3942348-6219-43c9-82a1-fb816d480ff7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:37.636931 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d3942348-6219-43c9-82a1-fb816d480ff7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:37.650236 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d3942348-6219-43c9-82a1-fb816d480ff7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:37.650973 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d3942348-6219-43c9-82a1-fb816d480ff7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:37.651932 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d3942348-6219-43c9-82a1-fb816d480ff7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:37.653317 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d3942348-6219-43c9-82a1-fb816d480ff7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:37.762640 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d3942348-6219-43c9-82a1-fb816d480ff7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:37.788018 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d3942348-6219-43c9-82a1-fb816d480ff7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:37.792211 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d3942348-6219-43c9-82a1-fb816d480ff7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:37.805398 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d3942348-6219-43c9-82a1-fb816d480ff7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1285 microversion: 2.20 time: 0.174876 Aug 27 01:30:37.821619 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 31/61] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:30:37 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1285 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:30:37.841721 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-8e0bfc2f-4fc6-4919-b1b8-a6ee5b05e80b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:37.841721 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-8e0bfc2f-4fc6-4919-b1b8-a6ee5b05e80b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:37.850791 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8e0bfc2f-4fc6-4919-b1b8-a6ee5b05e80b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:37.852361 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8e0bfc2f-4fc6-4919-b1b8-a6ee5b05e80b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:37.863793 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8e0bfc2f-4fc6-4919-b1b8-a6ee5b05e80b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:37.866492 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8e0bfc2f-4fc6-4919-b1b8-a6ee5b05e80b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:38.290620 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-01491023-3a1b-42c7-81a9-a0fefa291fd2 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:38.309421 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-01491023-3a1b-42c7-81a9-a0fefa291fd2 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.833659 Aug 27 01:30:38.310212 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 31/62] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:37 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:38.343728 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-8e0bfc2f-4fc6-4919-b1b8-a6ee5b05e80b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:38.355385 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-8e0bfc2f-4fc6-4919-b1b8-a6ee5b05e80b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1362 microversion: 2.1 time: 0.527573 Aug 27 01:30:38.355385 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 32/63] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:37 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1362 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:30:38.463641 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-9b99b576-5bce-49df-9608-7a0dd7fbefb9 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:38.489059 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-9b99b576-5bce-49df-9608-7a0dd7fbefb9 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:38.519734 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9b99b576-5bce-49df-9608-7a0dd7fbefb9 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:38.522826 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9b99b576-5bce-49df-9608-7a0dd7fbefb9 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:38.526936 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9b99b576-5bce-49df-9608-7a0dd7fbefb9 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:38.529464 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9b99b576-5bce-49df-9608-7a0dd7fbefb9 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:38.635765 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-9e5e2708-1c4c-49f2-9a10-ccdd3b71950f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:38.636681 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-9e5e2708-1c4c-49f2-9a10-ccdd3b71950f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:38.656266 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9e5e2708-1c4c-49f2-9a10-ccdd3b71950f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:38.656764 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9e5e2708-1c4c-49f2-9a10-ccdd3b71950f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:38.657608 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9e5e2708-1c4c-49f2-9a10-ccdd3b71950f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:38.661529 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9e5e2708-1c4c-49f2-9a10-ccdd3b71950f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:38.875606 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-9e5e2708-1c4c-49f2-9a10-ccdd3b71950f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:38.885130 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-9e5e2708-1c4c-49f2-9a10-ccdd3b71950f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1226 microversion: 2.1 time: 0.253314 Aug 27 01:30:38.895393 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 33/64] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:38 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1226 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:30:38.900264 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4efc5f69-da8e-4c9e-ae2a-3d3eaf3f0f16 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:38.900887 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4efc5f69-da8e-4c9e-ae2a-3d3eaf3f0f16 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:38.913716 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4efc5f69-da8e-4c9e-ae2a-3d3eaf3f0f16 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:38.914424 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4efc5f69-da8e-4c9e-ae2a-3d3eaf3f0f16 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:38.915578 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4efc5f69-da8e-4c9e-ae2a-3d3eaf3f0f16 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:38.916320 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4efc5f69-da8e-4c9e-ae2a-3d3eaf3f0f16 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:39.033450 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4efc5f69-da8e-4c9e-ae2a-3d3eaf3f0f16 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:39.047675 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4efc5f69-da8e-4c9e-ae2a-3d3eaf3f0f16 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:39.049428 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4efc5f69-da8e-4c9e-ae2a-3d3eaf3f0f16 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:39.050996 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4efc5f69-da8e-4c9e-ae2a-3d3eaf3f0f16 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1277 microversion: 2.20 time: 0.154077 Aug 27 01:30:39.053389 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 34/65] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:30:38 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:30:39.338079 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-037b5a07-bbc0-46dd-a889-7712ebfe6e18 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:39.339890 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-037b5a07-bbc0-46dd-a889-7712ebfe6e18 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:39.352109 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-037b5a07-bbc0-46dd-a889-7712ebfe6e18 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:39.352704 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-037b5a07-bbc0-46dd-a889-7712ebfe6e18 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:39.353429 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-037b5a07-bbc0-46dd-a889-7712ebfe6e18 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:39.354084 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-037b5a07-bbc0-46dd-a889-7712ebfe6e18 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:39.707364 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-9b99b576-5bce-49df-9608-7a0dd7fbefb9 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:39.735777 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-9b99b576-5bce-49df-9608-7a0dd7fbefb9 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 1.288156 Aug 27 01:30:39.736411 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 32/66] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:38 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:39.778886 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-adc59a4d-bdff-40cb-82fe-10bd72ccf860 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:39.780363 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-adc59a4d-bdff-40cb-82fe-10bd72ccf860 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:39.800962 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-adc59a4d-bdff-40cb-82fe-10bd72ccf860 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:39.800962 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-adc59a4d-bdff-40cb-82fe-10bd72ccf860 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:39.803593 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-adc59a4d-bdff-40cb-82fe-10bd72ccf860 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:39.804237 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-adc59a4d-bdff-40cb-82fe-10bd72ccf860 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:40.024526 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-037b5a07-bbc0-46dd-a889-7712ebfe6e18 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:40.053427 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-037b5a07-bbc0-46dd-a889-7712ebfe6e18 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.730518 Aug 27 01:30:40.054346 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 35/67] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:39 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:30:40.066148 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-3c67c7eb-5c8e-4781-8b55-a1e7e37201bd tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:40.067108 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-3c67c7eb-5c8e-4781-8b55-a1e7e37201bd tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:40.081002 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3c67c7eb-5c8e-4781-8b55-a1e7e37201bd tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:40.082887 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3c67c7eb-5c8e-4781-8b55-a1e7e37201bd tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:40.086912 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3c67c7eb-5c8e-4781-8b55-a1e7e37201bd tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:40.087685 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3c67c7eb-5c8e-4781-8b55-a1e7e37201bd tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:40.224177 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-3c67c7eb-5c8e-4781-8b55-a1e7e37201bd tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:40.239719 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-3c67c7eb-5c8e-4781-8b55-a1e7e37201bd tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1218 microversion: 2.1 time: 0.182996 Aug 27 01:30:40.250705 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 36/68] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:40 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1218 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:40.257677 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-38eca4c5-ba0a-47fa-96de-81b32196c4a0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:40.258594 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-38eca4c5-ba0a-47fa-96de-81b32196c4a0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:40.281407 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-38eca4c5-ba0a-47fa-96de-81b32196c4a0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:40.282375 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-38eca4c5-ba0a-47fa-96de-81b32196c4a0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:40.283410 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-38eca4c5-ba0a-47fa-96de-81b32196c4a0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:40.284076 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-38eca4c5-ba0a-47fa-96de-81b32196c4a0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:40.352639 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-adc59a4d-bdff-40cb-82fe-10bd72ccf860 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:40.364328 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-adc59a4d-bdff-40cb-82fe-10bd72ccf860 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1362 microversion: 2.1 time: 0.609885 Aug 27 01:30:40.382577 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 33/69] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:39 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1362 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:40.455169 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-38eca4c5-ba0a-47fa-96de-81b32196c4a0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:40.475370 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-38eca4c5-ba0a-47fa-96de-81b32196c4a0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:40.479036 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-38eca4c5-ba0a-47fa-96de-81b32196c4a0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:40.491632 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-38eca4c5-ba0a-47fa-96de-81b32196c4a0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1333 microversion: 2.20 time: 0.228348 Aug 27 01:30:40.491632 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 37/70] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:30:40 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1333 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:30:40.754948 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-68a72467-955e-40da-9c2e-331345a64c9e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:40.755553 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-68a72467-955e-40da-9c2e-331345a64c9e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:40.763323 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-68a72467-955e-40da-9c2e-331345a64c9e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:40.763764 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-68a72467-955e-40da-9c2e-331345a64c9e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:40.765095 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-68a72467-955e-40da-9c2e-331345a64c9e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:40.765522 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-68a72467-955e-40da-9c2e-331345a64c9e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:41.074133 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-e8f8c46c-3996-40c9-8988-c27011cb2bba tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:41.075201 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-e8f8c46c-3996-40c9-8988-c27011cb2bba tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:41.077482 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-68a72467-955e-40da-9c2e-331345a64c9e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:41.089411 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e8f8c46c-3996-40c9-8988-c27011cb2bba tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:41.089824 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-68a72467-955e-40da-9c2e-331345a64c9e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 0.339498 Aug 27 01:30:41.090500 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 34/71] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:40 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:41.090917 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e8f8c46c-3996-40c9-8988-c27011cb2bba tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:41.092775 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e8f8c46c-3996-40c9-8988-c27011cb2bba tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:41.093866 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e8f8c46c-3996-40c9-8988-c27011cb2bba tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:41.261711 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-4cef9557-d28f-40c5-9ff7-1d22eb3a5e8c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:41.262663 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-4cef9557-d28f-40c5-9ff7-1d22eb3a5e8c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:41.274124 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-e8f8c46c-3996-40c9-8988-c27011cb2bba tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:41.277125 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4cef9557-d28f-40c5-9ff7-1d22eb3a5e8c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:41.277958 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4cef9557-d28f-40c5-9ff7-1d22eb3a5e8c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:41.280143 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4cef9557-d28f-40c5-9ff7-1d22eb3a5e8c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:41.283480 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4cef9557-d28f-40c5-9ff7-1d22eb3a5e8c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:41.292485 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-e8f8c46c-3996-40c9-8988-c27011cb2bba tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.223717 Aug 27 01:30:41.311240 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 38/72] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:41 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:30:41.392449 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-aadb535a-2b2c-4075-b1c3-26de5df19345 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:41.393343 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-aadb535a-2b2c-4075-b1c3-26de5df19345 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:41.409704 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-aadb535a-2b2c-4075-b1c3-26de5df19345 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:41.410160 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-aadb535a-2b2c-4075-b1c3-26de5df19345 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:41.410951 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-aadb535a-2b2c-4075-b1c3-26de5df19345 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:41.411389 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-aadb535a-2b2c-4075-b1c3-26de5df19345 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:41.582277 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-4cef9557-d28f-40c5-9ff7-1d22eb3a5e8c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:41.593473 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-4cef9557-d28f-40c5-9ff7-1d22eb3a5e8c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1218 microversion: 2.1 time: 0.335196 Aug 27 01:30:41.608433 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 35/73] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:41 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1218 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:41.620145 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-e685d220-d48a-4e2b-beba-66600bd5376f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:41.621949 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-e685d220-d48a-4e2b-beba-66600bd5376f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:41.631061 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e685d220-d48a-4e2b-beba-66600bd5376f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:41.631742 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e685d220-d48a-4e2b-beba-66600bd5376f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:41.632695 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e685d220-d48a-4e2b-beba-66600bd5376f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:41.633470 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e685d220-d48a-4e2b-beba-66600bd5376f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:41.781524 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-e685d220-d48a-4e2b-beba-66600bd5376f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:41.802445 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-e685d220-d48a-4e2b-beba-66600bd5376f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:41.807287 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-e685d220-d48a-4e2b-beba-66600bd5376f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:41.809955 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-e685d220-d48a-4e2b-beba-66600bd5376f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1333 microversion: 2.20 time: 0.195210 Aug 27 01:30:41.822043 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 36/74] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:30:41 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1333 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:30:41.914938 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-28ed8efd-e7f6-401f-ad1b-4ac70081a0f2 req-285e5864-81c1-4ebb-ad8f-601def10808d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be807b17-abdc-4d79-b58d-b42998cdb479", "tag": "f18d8c2b-ab08-4402-a440-92bdcf75c38a"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:30:41.918831 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:30:41.918831 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:30:41.926004 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-28ed8efd-e7f6-401f-ad1b-4ac70081a0f2 req-285e5864-81c1-4ebb-ad8f-601def10808d service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:41.926679 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-28ed8efd-e7f6-401f-ad1b-4ac70081a0f2 req-285e5864-81c1-4ebb-ad8f-601def10808d service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:41.942133 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-28ed8efd-e7f6-401f-ad1b-4ac70081a0f2 req-285e5864-81c1-4ebb-ad8f-601def10808d service nova] Creating event network-changed:f18d8c2b-ab08-4402-a440-92bdcf75c38a for instance be807b17-abdc-4d79-b58d-b42998cdb479 on hv-cinder-75916 Aug 27 01:30:41.948949 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-28ed8efd-e7f6-401f-ad1b-4ac70081a0f2 req-285e5864-81c1-4ebb-ad8f-601def10808d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135500 Aug 27 01:30:41.956882 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 37/75] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:30:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:30:42.111318 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-cb714274-c5bd-4b4e-a4da-626da3f13c0e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:42.112221 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-cb714274-c5bd-4b4e-a4da-626da3f13c0e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:42.122551 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cb714274-c5bd-4b4e-a4da-626da3f13c0e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:42.123598 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cb714274-c5bd-4b4e-a4da-626da3f13c0e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:42.124604 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cb714274-c5bd-4b4e-a4da-626da3f13c0e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:42.125395 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cb714274-c5bd-4b4e-a4da-626da3f13c0e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:42.246722 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-aadb535a-2b2c-4075-b1c3-26de5df19345 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:42.257409 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-aadb535a-2b2c-4075-b1c3-26de5df19345 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1362 microversion: 2.1 time: 0.875838 Aug 27 01:30:42.267070 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 39/76] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:41 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1362 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:42.314678 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-af42e7b2-e7a5-4c2e-a4a6-cf7144f57b7b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:42.315815 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-af42e7b2-e7a5-4c2e-a4a6-cf7144f57b7b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:42.325106 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-af42e7b2-e7a5-4c2e-a4a6-cf7144f57b7b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:42.331844 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-af42e7b2-e7a5-4c2e-a4a6-cf7144f57b7b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:42.331844 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-af42e7b2-e7a5-4c2e-a4a6-cf7144f57b7b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:42.331844 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-af42e7b2-e7a5-4c2e-a4a6-cf7144f57b7b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:42.711041 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-cb714274-c5bd-4b4e-a4da-626da3f13c0e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:42.726444 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-cb714274-c5bd-4b4e-a4da-626da3f13c0e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 0.619988 Aug 27 01:30:42.727363 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 38/77] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:42 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:42.731953 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c90bf6a1-963c-46d4-9e57-dff542770dfc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:42.732630 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c90bf6a1-963c-46d4-9e57-dff542770dfc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:42.742050 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c90bf6a1-963c-46d4-9e57-dff542770dfc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:42.743641 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c90bf6a1-963c-46d4-9e57-dff542770dfc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:42.743641 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c90bf6a1-963c-46d4-9e57-dff542770dfc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:42.744044 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c90bf6a1-963c-46d4-9e57-dff542770dfc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:42.837330 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-af42e7b2-e7a5-4c2e-a4a6-cf7144f57b7b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:42.853825 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c90bf6a1-963c-46d4-9e57-dff542770dfc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:42.865114 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c90bf6a1-963c-46d4-9e57-dff542770dfc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1274 microversion: 2.1 time: 0.135484 Aug 27 01:30:42.867182 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 39/78] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:42 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1274 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:42.867311 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-af42e7b2-e7a5-4c2e-a4a6-cf7144f57b7b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.549362 Aug 27 01:30:42.867993 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 40/79] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:42 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:30:42.877064 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-eb42e01f-f413-4196-910e-2d30fb5aefd8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:42.878906 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-eb42e01f-f413-4196-910e-2d30fb5aefd8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:42.895561 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-eb42e01f-f413-4196-910e-2d30fb5aefd8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:42.895561 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-eb42e01f-f413-4196-910e-2d30fb5aefd8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:42.895561 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-eb42e01f-f413-4196-910e-2d30fb5aefd8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:42.895561 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-eb42e01f-f413-4196-910e-2d30fb5aefd8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:42.972332 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-eb42e01f-f413-4196-910e-2d30fb5aefd8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:42.981279 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-eb42e01f-f413-4196-910e-2d30fb5aefd8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:42.984217 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-eb42e01f-f413-4196-910e-2d30fb5aefd8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:42.985760 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-eb42e01f-f413-4196-910e-2d30fb5aefd8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1339 microversion: 2.20 time: 0.117215 Aug 27 01:30:42.989114 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 40/80] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:30:42 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1339 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:30:43.273895 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-f2d2e289-6aa2-4b42-9496-e64228c7a4ae tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:43.274505 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-f2d2e289-6aa2-4b42-9496-e64228c7a4ae tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:43.288478 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f2d2e289-6aa2-4b42-9496-e64228c7a4ae tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:43.291206 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f2d2e289-6aa2-4b42-9496-e64228c7a4ae tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:43.294689 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f2d2e289-6aa2-4b42-9496-e64228c7a4ae tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:43.297370 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f2d2e289-6aa2-4b42-9496-e64228c7a4ae tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:43.645210 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-f2d2e289-6aa2-4b42-9496-e64228c7a4ae tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:43.652436 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-f2d2e289-6aa2-4b42-9496-e64228c7a4ae tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1362 microversion: 2.1 time: 0.382018 Aug 27 01:30:43.653357 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 41/81] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:43 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1362 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:43.742301 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-2f0021c4-97b9-4171-b0dc-912dd87ac9fd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:43.747463 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-2f0021c4-97b9-4171-b0dc-912dd87ac9fd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:43.750454 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2f0021c4-97b9-4171-b0dc-912dd87ac9fd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:43.750894 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2f0021c4-97b9-4171-b0dc-912dd87ac9fd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:43.751932 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2f0021c4-97b9-4171-b0dc-912dd87ac9fd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:43.752505 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2f0021c4-97b9-4171-b0dc-912dd87ac9fd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:43.889910 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-8d031a44-6c26-478c-aa15-e3bef8aed132 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:43.890765 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-8d031a44-6c26-478c-aa15-e3bef8aed132 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:43.904048 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8d031a44-6c26-478c-aa15-e3bef8aed132 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:43.905051 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8d031a44-6c26-478c-aa15-e3bef8aed132 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:43.906058 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8d031a44-6c26-478c-aa15-e3bef8aed132 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:43.906842 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8d031a44-6c26-478c-aa15-e3bef8aed132 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:43.934692 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-2f0021c4-97b9-4171-b0dc-912dd87ac9fd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:43.943468 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-2f0021c4-97b9-4171-b0dc-912dd87ac9fd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 0.204781 Aug 27 01:30:43.944040 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 41/82] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:43 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:43.955739 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-bfc9115d-da63-4fdc-b36a-93887260034b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:43.956481 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-bfc9115d-da63-4fdc-b36a-93887260034b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:43.965832 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bfc9115d-da63-4fdc-b36a-93887260034b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:43.969702 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bfc9115d-da63-4fdc-b36a-93887260034b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:43.972690 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bfc9115d-da63-4fdc-b36a-93887260034b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:43.972690 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bfc9115d-da63-4fdc-b36a-93887260034b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:43.995229 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-8d031a44-6c26-478c-aa15-e3bef8aed132 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:44.007740 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-8d031a44-6c26-478c-aa15-e3bef8aed132 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1280 microversion: 2.1 time: 0.128022 Aug 27 01:30:44.008935 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 42/83] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:43 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1280 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:44.022007 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b68f95fb-7cfe-4b1f-99b2-577079223197 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:44.022870 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b68f95fb-7cfe-4b1f-99b2-577079223197 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:44.033905 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b68f95fb-7cfe-4b1f-99b2-577079223197 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:44.034798 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b68f95fb-7cfe-4b1f-99b2-577079223197 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:44.037788 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b68f95fb-7cfe-4b1f-99b2-577079223197 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:44.038386 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b68f95fb-7cfe-4b1f-99b2-577079223197 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:44.253722 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-b68f95fb-7cfe-4b1f-99b2-577079223197 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:44.268608 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-b68f95fb-7cfe-4b1f-99b2-577079223197 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:44.275217 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-b68f95fb-7cfe-4b1f-99b2-577079223197 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:44.276469 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-bfc9115d-da63-4fdc-b36a-93887260034b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:44.277308 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b68f95fb-7cfe-4b1f-99b2-577079223197 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1406 microversion: 2.20 time: 0.267289 Aug 27 01:30:44.280964 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 43/84] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:30:44 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1406 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:30:44.293821 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-bfc9115d-da63-4fdc-b36a-93887260034b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.348479 Aug 27 01:30:44.294408 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 42/85] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:43 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:44.673096 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-93f88357-1503-467a-9a89-38473175dffe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:44.678028 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-93f88357-1503-467a-9a89-38473175dffe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:44.693364 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-93f88357-1503-467a-9a89-38473175dffe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:44.694063 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-93f88357-1503-467a-9a89-38473175dffe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:44.695324 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-93f88357-1503-467a-9a89-38473175dffe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:44.695959 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-93f88357-1503-467a-9a89-38473175dffe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:44.851386 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-93f88357-1503-467a-9a89-38473175dffe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:44.854111 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-93f88357-1503-467a-9a89-38473175dffe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1362 microversion: 2.1 time: 0.187526 Aug 27 01:30:44.857234 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 44/86] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:44 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:44.960939 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-b52a6e84-25f8-444e-8f65-b6bec5064de5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:44.961545 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-b52a6e84-25f8-444e-8f65-b6bec5064de5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:44.968417 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b52a6e84-25f8-444e-8f65-b6bec5064de5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:44.977087 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b52a6e84-25f8-444e-8f65-b6bec5064de5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:44.977087 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b52a6e84-25f8-444e-8f65-b6bec5064de5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:44.977087 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b52a6e84-25f8-444e-8f65-b6bec5064de5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:45.026603 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-9b0e06d2-ddfe-41b4-91c1-a668a11cb246 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:45.027216 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-9b0e06d2-ddfe-41b4-91c1-a668a11cb246 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:45.034368 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9b0e06d2-ddfe-41b4-91c1-a668a11cb246 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:45.034902 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9b0e06d2-ddfe-41b4-91c1-a668a11cb246 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:45.035682 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9b0e06d2-ddfe-41b4-91c1-a668a11cb246 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:45.036267 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9b0e06d2-ddfe-41b4-91c1-a668a11cb246 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:45.130122 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-9b0e06d2-ddfe-41b4-91c1-a668a11cb246 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:45.135091 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-b52a6e84-25f8-444e-8f65-b6bec5064de5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:45.143607 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-b52a6e84-25f8-444e-8f65-b6bec5064de5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 0.185540 Aug 27 01:30:45.161159 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 43/87] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:44 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:45.162246 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-9b0e06d2-ddfe-41b4-91c1-a668a11cb246 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1280 microversion: 2.1 time: 0.131530 Aug 27 01:30:45.162246 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 45/88] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:45 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1280 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:30:45.296112 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-30a56203-4c4a-4971-b7cc-070ad5050174 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:45.296822 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-30a56203-4c4a-4971-b7cc-070ad5050174 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:45.302904 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-30a56203-4c4a-4971-b7cc-070ad5050174 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:45.303354 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-30a56203-4c4a-4971-b7cc-070ad5050174 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:45.304127 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-30a56203-4c4a-4971-b7cc-070ad5050174 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:45.304563 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-30a56203-4c4a-4971-b7cc-070ad5050174 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:45.312973 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-c319113b-ef1b-4c62-a201-7fb12c28a05c tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:45.313583 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-c319113b-ef1b-4c62-a201-7fb12c28a05c tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:45.319989 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c319113b-ef1b-4c62-a201-7fb12c28a05c tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:45.320495 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c319113b-ef1b-4c62-a201-7fb12c28a05c tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:45.321725 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c319113b-ef1b-4c62-a201-7fb12c28a05c tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:45.322316 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c319113b-ef1b-4c62-a201-7fb12c28a05c tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:45.452570 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-30a56203-4c4a-4971-b7cc-070ad5050174 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:45.463608 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-30a56203-4c4a-4971-b7cc-070ad5050174 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:45.464558 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-30a56203-4c4a-4971-b7cc-070ad5050174 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:45.465866 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-30a56203-4c4a-4971-b7cc-070ad5050174 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1406 microversion: 2.20 time: 0.174235 Aug 27 01:30:45.467165 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 44/89] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:30:45 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:30:45.497606 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-c319113b-ef1b-4c62-a201-7fb12c28a05c tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:45.509572 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-c319113b-ef1b-4c62-a201-7fb12c28a05c tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.201534 Aug 27 01:30:45.511849 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 46/90] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:45 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:30:45.872164 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-6eeecde9-6747-4a55-959d-11414b131d2f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:45.873408 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-6eeecde9-6747-4a55-959d-11414b131d2f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:45.880697 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6eeecde9-6747-4a55-959d-11414b131d2f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:45.881687 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6eeecde9-6747-4a55-959d-11414b131d2f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:45.883190 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6eeecde9-6747-4a55-959d-11414b131d2f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:45.883801 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6eeecde9-6747-4a55-959d-11414b131d2f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:46.021340 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-6eeecde9-6747-4a55-959d-11414b131d2f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:46.028648 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-6eeecde9-6747-4a55-959d-11414b131d2f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1362 microversion: 2.1 time: 0.161144 Aug 27 01:30:46.029292 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 45/91] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:45 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:46.159611 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-a83cb149-1aa0-4a61-bfe5-1a99e9a689c8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:46.160215 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-a83cb149-1aa0-4a61-bfe5-1a99e9a689c8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:46.172779 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-7c57c0fc-1bb9-4c45-9277-4a31db9a1fb3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:46.174265 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-7c57c0fc-1bb9-4c45-9277-4a31db9a1fb3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:46.178363 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a83cb149-1aa0-4a61-bfe5-1a99e9a689c8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:46.178363 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a83cb149-1aa0-4a61-bfe5-1a99e9a689c8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:46.178695 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a83cb149-1aa0-4a61-bfe5-1a99e9a689c8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:46.178979 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a83cb149-1aa0-4a61-bfe5-1a99e9a689c8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:46.184638 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7c57c0fc-1bb9-4c45-9277-4a31db9a1fb3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:46.185644 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7c57c0fc-1bb9-4c45-9277-4a31db9a1fb3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:46.186687 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7c57c0fc-1bb9-4c45-9277-4a31db9a1fb3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:46.189205 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7c57c0fc-1bb9-4c45-9277-4a31db9a1fb3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:46.278418 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-7c57c0fc-1bb9-4c45-9277-4a31db9a1fb3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:46.293266 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-7c57c0fc-1bb9-4c45-9277-4a31db9a1fb3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1280 microversion: 2.1 time: 0.120449 Aug 27 01:30:46.293266 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 46/92] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:46 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1280 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:30:46.489164 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-18032c0f-90d2-4d9d-b89f-1b17135a9482 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:46.489944 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-18032c0f-90d2-4d9d-b89f-1b17135a9482 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:46.507782 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-18032c0f-90d2-4d9d-b89f-1b17135a9482 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:46.507782 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-18032c0f-90d2-4d9d-b89f-1b17135a9482 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:46.514828 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-18032c0f-90d2-4d9d-b89f-1b17135a9482 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:46.515334 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-18032c0f-90d2-4d9d-b89f-1b17135a9482 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:46.664593 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-a83cb149-1aa0-4a61-bfe5-1a99e9a689c8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:46.687447 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-a83cb149-1aa0-4a61-bfe5-1a99e9a689c8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 0.531091 Aug 27 01:30:46.688234 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 47/93] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:46 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:30:46.698277 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-25ba8aff-4c9e-4514-900d-e32601cdec74 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:46.698277 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-25ba8aff-4c9e-4514-900d-e32601cdec74 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:46.712100 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-25ba8aff-4c9e-4514-900d-e32601cdec74 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:46.727436 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-25ba8aff-4c9e-4514-900d-e32601cdec74 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:46.728347 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-25ba8aff-4c9e-4514-900d-e32601cdec74 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:46.728793 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-25ba8aff-4c9e-4514-900d-e32601cdec74 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:47.064427 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-18032c0f-90d2-4d9d-b89f-1b17135a9482 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:47.077456 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-18032c0f-90d2-4d9d-b89f-1b17135a9482 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:47.081653 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-18032c0f-90d2-4d9d-b89f-1b17135a9482 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:47.083066 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-18032c0f-90d2-4d9d-b89f-1b17135a9482 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1406 microversion: 2.20 time: 0.598729 Aug 27 01:30:47.086784 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 47/94] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:30:46 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1406 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:30:47.096417 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-800ae06b-224a-4787-a57e-e34a361cb5c1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:47.099652 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-800ae06b-224a-4787-a57e-e34a361cb5c1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:47.114373 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-800ae06b-224a-4787-a57e-e34a361cb5c1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:47.115179 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-800ae06b-224a-4787-a57e-e34a361cb5c1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:47.116658 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-800ae06b-224a-4787-a57e-e34a361cb5c1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:47.117375 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-800ae06b-224a-4787-a57e-e34a361cb5c1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:47.301291 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-25ba8aff-4c9e-4514-900d-e32601cdec74 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:47.311607 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-25ba8aff-4c9e-4514-900d-e32601cdec74 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.618980 Aug 27 01:30:47.312486 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 48/95] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:46 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:47.318860 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-64f3b7ca-5f4a-434d-ab38-63ab2bd1d2d0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:47.320681 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-64f3b7ca-5f4a-434d-ab38-63ab2bd1d2d0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:47.338682 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-64f3b7ca-5f4a-434d-ab38-63ab2bd1d2d0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:47.339664 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-64f3b7ca-5f4a-434d-ab38-63ab2bd1d2d0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:47.341373 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-64f3b7ca-5f4a-434d-ab38-63ab2bd1d2d0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:47.343678 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-64f3b7ca-5f4a-434d-ab38-63ab2bd1d2d0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:47.434632 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-64f3b7ca-5f4a-434d-ab38-63ab2bd1d2d0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:47.442839 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-64f3b7ca-5f4a-434d-ab38-63ab2bd1d2d0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1280 microversion: 2.1 time: 0.129154 Aug 27 01:30:47.453354 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 49/96] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:47 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1280 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:47.485798 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-800ae06b-224a-4787-a57e-e34a361cb5c1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:47.500341 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-800ae06b-224a-4787-a57e-e34a361cb5c1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1362 microversion: 2.1 time: 0.411687 Aug 27 01:30:47.500983 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 48/97] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:47 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1362 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:47.708355 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-1fca609d-5755-43ca-84f9-e6cede08238b tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:47.709149 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-1fca609d-5755-43ca-84f9-e6cede08238b tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:47.726157 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1fca609d-5755-43ca-84f9-e6cede08238b tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:47.731984 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1fca609d-5755-43ca-84f9-e6cede08238b tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:47.731984 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1fca609d-5755-43ca-84f9-e6cede08238b tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:47.732595 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1fca609d-5755-43ca-84f9-e6cede08238b tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:48.109450 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-6bf5c3fe-b4c5-4bb4-9512-67fd6be54ba5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:48.110622 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-6bf5c3fe-b4c5-4bb4-9512-67fd6be54ba5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:48.130810 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6bf5c3fe-b4c5-4bb4-9512-67fd6be54ba5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:48.132053 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6bf5c3fe-b4c5-4bb4-9512-67fd6be54ba5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:48.133242 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6bf5c3fe-b4c5-4bb4-9512-67fd6be54ba5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:48.133826 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6bf5c3fe-b4c5-4bb4-9512-67fd6be54ba5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:48.355210 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-1fca609d-5755-43ca-84f9-e6cede08238b tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:48.367574 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-1fca609d-5755-43ca-84f9-e6cede08238b tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 0.667659 Aug 27 01:30:48.370493 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 50/98] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:47 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:48.375998 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-a4099612-a036-4b3c-9f12-e6494688c4de req-68c1dde4-570a-4731-90f5-ceb4d14bc3b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ec83298-8a1e-4edd-be07-4e0592a0ce04", "tag": "5f7cab4d-54ba-4757-bb8d-1d2f0a14a90e"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:30:48.384094 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:30:48.384094 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:30:48.442994 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-a4099612-a036-4b3c-9f12-e6494688c4de req-68c1dde4-570a-4731-90f5-ceb4d14bc3b8 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:48.443966 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-a4099612-a036-4b3c-9f12-e6494688c4de req-68c1dde4-570a-4731-90f5-ceb4d14bc3b8 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:48.522179 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-a4099612-a036-4b3c-9f12-e6494688c4de req-68c1dde4-570a-4731-90f5-ceb4d14bc3b8 service nova] Creating event network-changed:5f7cab4d-54ba-4757-bb8d-1d2f0a14a90e for instance 6ec83298-8a1e-4edd-be07-4e0592a0ce04 on hv-cinder-75916 Aug 27 01:30:48.523090 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-a4099612-a036-4b3c-9f12-e6494688c4de req-68c1dde4-570a-4731-90f5-ceb4d14bc3b8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=108755) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 27 01:30:48.524593 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2506acba-a83c-4b67-85b8-700548cc4a1b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:48.530469 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2506acba-a83c-4b67-85b8-700548cc4a1b None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:48.531503 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2506acba-a83c-4b67-85b8-700548cc4a1b None None] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:48.533972 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2506acba-a83c-4b67-85b8-700548cc4a1b None None] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:48.562127 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.compute.rpcapi [None req-2506acba-a83c-4b67-85b8-700548cc4a1b None None] Automatically selected compute RPC version 6.0 from minimum service version 57 Aug 27 01:30:48.562999 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2506acba-a83c-4b67-85b8-700548cc4a1b None None] Releasing lock "compute-rpcapi-router" {{(pid=108755) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 27 01:30:48.605574 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-2506acba-a83c-4b67-85b8-700548cc4a1b None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.230178 Aug 27 01:30:48.605574 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 51/99] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:30:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:30:48.609140 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-2f30aa24-ccab-49db-9bc0-82d04e969250 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:48.614369 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-2f30aa24-ccab-49db-9bc0-82d04e969250 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:48.622215 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2f30aa24-ccab-49db-9bc0-82d04e969250 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:48.627244 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2f30aa24-ccab-49db-9bc0-82d04e969250 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:48.633667 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2f30aa24-ccab-49db-9bc0-82d04e969250 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:48.633667 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2f30aa24-ccab-49db-9bc0-82d04e969250 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:48.976660 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-2f30aa24-ccab-49db-9bc0-82d04e969250 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:48.998808 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-2f30aa24-ccab-49db-9bc0-82d04e969250 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.393170 Aug 27 01:30:49.002086 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 52/100] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:48 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:49.015675 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-6bf5c3fe-b4c5-4bb4-9512-67fd6be54ba5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:49.022071 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d98098d8-716a-4ff2-8f0a-d8492fb04999 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:49.023045 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d98098d8-716a-4ff2-8f0a-d8492fb04999 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:49.025039 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-6bf5c3fe-b4c5-4bb4-9512-67fd6be54ba5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:49.026784 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-6bf5c3fe-b4c5-4bb4-9512-67fd6be54ba5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:49.028127 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-6bf5c3fe-b4c5-4bb4-9512-67fd6be54ba5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1406 microversion: 2.20 time: 0.926804 Aug 27 01:30:49.029387 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 49/101] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:30:48 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1406 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:30:49.034011 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-7bd6aa04-2a3f-4d91-8219-9c094f1f68d9 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:49.034969 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-7bd6aa04-2a3f-4d91-8219-9c094f1f68d9 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:49.036979 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d98098d8-716a-4ff2-8f0a-d8492fb04999 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:49.037295 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d98098d8-716a-4ff2-8f0a-d8492fb04999 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:49.038071 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d98098d8-716a-4ff2-8f0a-d8492fb04999 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:49.038513 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d98098d8-716a-4ff2-8f0a-d8492fb04999 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:49.042166 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7bd6aa04-2a3f-4d91-8219-9c094f1f68d9 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:49.042790 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7bd6aa04-2a3f-4d91-8219-9c094f1f68d9 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:49.043576 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7bd6aa04-2a3f-4d91-8219-9c094f1f68d9 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:49.045752 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7bd6aa04-2a3f-4d91-8219-9c094f1f68d9 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:49.213271 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d98098d8-716a-4ff2-8f0a-d8492fb04999 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:49.222636 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d98098d8-716a-4ff2-8f0a-d8492fb04999 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1322 microversion: 2.1 time: 0.215884 Aug 27 01:30:49.222981 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 53/102] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:49 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:49.227339 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-da610f14-3972-418a-8d30-b1b14aa93ea9 req-66235609-4815-4555-82c2-4c1efff0348c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f0c2a27-bde3-4d4a-894b-be6dc9ed6118", "tag": "0f68a3b4-5d9c-4b17-875e-e3990c07efa7"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:30:49.228898 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:30:49.228898 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:30:49.236096 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-da610f14-3972-418a-8d30-b1b14aa93ea9 req-66235609-4815-4555-82c2-4c1efff0348c service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:49.236536 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-da610f14-3972-418a-8d30-b1b14aa93ea9 req-66235609-4815-4555-82c2-4c1efff0348c service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:49.247613 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-da610f14-3972-418a-8d30-b1b14aa93ea9 req-66235609-4815-4555-82c2-4c1efff0348c service nova] Creating event network-changed:0f68a3b4-5d9c-4b17-875e-e3990c07efa7 for instance 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 on hv-cinder-75916 Aug 27 01:30:49.252974 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-da610f14-3972-418a-8d30-b1b14aa93ea9 req-66235609-4815-4555-82c2-4c1efff0348c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028862 Aug 27 01:30:49.253734 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 54/103] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:30:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:30:49.308539 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-7bd6aa04-2a3f-4d91-8219-9c094f1f68d9 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:49.316206 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-7bd6aa04-2a3f-4d91-8219-9c094f1f68d9 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1362 microversion: 2.1 time: 0.285571 Aug 27 01:30:49.316775 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 50/104] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:49 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1362 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:49.385510 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-848bdcab-78bb-4f4a-96af-aa567cb813b0 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:49.386207 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-848bdcab-78bb-4f4a-96af-aa567cb813b0 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:49.392529 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-848bdcab-78bb-4f4a-96af-aa567cb813b0 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:49.393014 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-848bdcab-78bb-4f4a-96af-aa567cb813b0 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:49.393781 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-848bdcab-78bb-4f4a-96af-aa567cb813b0 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:49.394216 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-848bdcab-78bb-4f4a-96af-aa567cb813b0 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:49.535294 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-848bdcab-78bb-4f4a-96af-aa567cb813b0 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:49.548478 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-848bdcab-78bb-4f4a-96af-aa567cb813b0 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 0.166909 Aug 27 01:30:49.556867 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 55/105] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:49 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:50.018566 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-83b70b99-cf32-4e8d-bf39-357c797a238a tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:50.019170 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-83b70b99-cf32-4e8d-bf39-357c797a238a tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:50.025062 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-83b70b99-cf32-4e8d-bf39-357c797a238a tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:50.025512 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-83b70b99-cf32-4e8d-bf39-357c797a238a tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:50.026266 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-83b70b99-cf32-4e8d-bf39-357c797a238a tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:50.026698 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-83b70b99-cf32-4e8d-bf39-357c797a238a tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:50.046024 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-f2cd6d10-64f0-4c56-9c7e-dc38b13d5833 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:50.046625 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-f2cd6d10-64f0-4c56-9c7e-dc38b13d5833 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:50.052325 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f2cd6d10-64f0-4c56-9c7e-dc38b13d5833 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:50.052763 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f2cd6d10-64f0-4c56-9c7e-dc38b13d5833 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:50.053553 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f2cd6d10-64f0-4c56-9c7e-dc38b13d5833 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:50.053981 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f2cd6d10-64f0-4c56-9c7e-dc38b13d5833 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:50.148470 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-83b70b99-cf32-4e8d-bf39-357c797a238a tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:50.155835 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-83b70b99-cf32-4e8d-bf39-357c797a238a tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.140895 Aug 27 01:30:50.156484 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 51/106] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:50 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:50.175265 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-f2cd6d10-64f0-4c56-9c7e-dc38b13d5833 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:50.183124 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-f2cd6d10-64f0-4c56-9c7e-dc38b13d5833 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:50.184610 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-f2cd6d10-64f0-4c56-9c7e-dc38b13d5833 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:50.186191 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-f2cd6d10-64f0-4c56-9c7e-dc38b13d5833 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1406 microversion: 2.20 time: 0.143892 Aug 27 01:30:50.186731 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 56/107] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:30:50 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1406 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:30:50.239503 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-75ae921b-d17f-4876-a2fd-a94bc109d8e9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:50.240112 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-75ae921b-d17f-4876-a2fd-a94bc109d8e9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:50.246003 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-75ae921b-d17f-4876-a2fd-a94bc109d8e9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:50.246451 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-75ae921b-d17f-4876-a2fd-a94bc109d8e9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:50.247208 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-75ae921b-d17f-4876-a2fd-a94bc109d8e9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:50.247643 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-75ae921b-d17f-4876-a2fd-a94bc109d8e9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:50.333007 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-7069d9d4-248d-461c-8323-a4eac58b91ba tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:50.333848 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-7069d9d4-248d-461c-8323-a4eac58b91ba tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:50.339892 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7069d9d4-248d-461c-8323-a4eac58b91ba tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:50.340341 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7069d9d4-248d-461c-8323-a4eac58b91ba tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:50.341140 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7069d9d4-248d-461c-8323-a4eac58b91ba tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:50.342657 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7069d9d4-248d-461c-8323-a4eac58b91ba tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:50.366529 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-75ae921b-d17f-4876-a2fd-a94bc109d8e9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:50.374882 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-75ae921b-d17f-4876-a2fd-a94bc109d8e9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1322 microversion: 2.1 time: 0.138954 Aug 27 01:30:50.375455 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 52/108] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:50 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1322 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:50.467274 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-7069d9d4-248d-461c-8323-a4eac58b91ba tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:50.474690 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-7069d9d4-248d-461c-8323-a4eac58b91ba tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1362 microversion: 2.1 time: 0.145306 Aug 27 01:30:50.475244 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 57/109] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:50 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:30:50.565844 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-110cc133-2740-4be2-91e0-7127af7dbbea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:50.566453 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-110cc133-2740-4be2-91e0-7127af7dbbea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:50.572639 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-110cc133-2740-4be2-91e0-7127af7dbbea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:50.573177 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-110cc133-2740-4be2-91e0-7127af7dbbea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:50.573945 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-110cc133-2740-4be2-91e0-7127af7dbbea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:50.574530 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-110cc133-2740-4be2-91e0-7127af7dbbea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:50.696903 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-110cc133-2740-4be2-91e0-7127af7dbbea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:50.704576 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-110cc133-2740-4be2-91e0-7127af7dbbea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 0.142428 Aug 27 01:30:50.705169 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 53/110] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:50 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:50.891715 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-c1a1b613-e76e-4ed2-b68e-4e98c08f1454 req-8b7514e5-4b73-491c-8e03-a8bca3110332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a469663-cc2c-4a11-8486-a758a0682e39", "tag": "f0fa47c1-eb17-4a46-982a-113bf408fe87"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:30:50.893530 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:30:50.893530 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:30:50.900377 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-c1a1b613-e76e-4ed2-b68e-4e98c08f1454 req-8b7514e5-4b73-491c-8e03-a8bca3110332 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:50.900819 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-c1a1b613-e76e-4ed2-b68e-4e98c08f1454 req-8b7514e5-4b73-491c-8e03-a8bca3110332 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:50.911880 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-c1a1b613-e76e-4ed2-b68e-4e98c08f1454 req-8b7514e5-4b73-491c-8e03-a8bca3110332 service nova] Creating event network-changed:f0fa47c1-eb17-4a46-982a-113bf408fe87 for instance 5a469663-cc2c-4a11-8486-a758a0682e39 on hv-cinder-75916 Aug 27 01:30:50.916711 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-c1a1b613-e76e-4ed2-b68e-4e98c08f1454 req-8b7514e5-4b73-491c-8e03-a8bca3110332 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029176 Aug 27 01:30:50.917296 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 58/111] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:30:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:30:51.173157 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-5706d336-374f-4630-85ed-358b086623ce tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:51.173764 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-5706d336-374f-4630-85ed-358b086623ce tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:51.180070 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5706d336-374f-4630-85ed-358b086623ce tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:51.180511 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5706d336-374f-4630-85ed-358b086623ce tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:51.181556 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5706d336-374f-4630-85ed-358b086623ce tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:51.182001 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5706d336-374f-4630-85ed-358b086623ce tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:51.206362 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-eb4ff216-80aa-4087-9e12-2296b4421b13 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:51.207532 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-eb4ff216-80aa-4087-9e12-2296b4421b13 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:51.215274 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-eb4ff216-80aa-4087-9e12-2296b4421b13 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:51.215954 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-eb4ff216-80aa-4087-9e12-2296b4421b13 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:51.217374 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-eb4ff216-80aa-4087-9e12-2296b4421b13 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:51.217811 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-eb4ff216-80aa-4087-9e12-2296b4421b13 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:51.423510 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-5706d336-374f-4630-85ed-358b086623ce tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:51.432898 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-5706d336-374f-4630-85ed-358b086623ce tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.263746 Aug 27 01:30:51.433668 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 54/112] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:51 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:30:51.439272 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-5243438d-fa6a-447d-96c1-ef1c3d5fec4f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:51.439869 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-5243438d-fa6a-447d-96c1-ef1c3d5fec4f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:51.445983 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5243438d-fa6a-447d-96c1-ef1c3d5fec4f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:51.446428 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5243438d-fa6a-447d-96c1-ef1c3d5fec4f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:51.447358 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5243438d-fa6a-447d-96c1-ef1c3d5fec4f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:51.447948 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5243438d-fa6a-447d-96c1-ef1c3d5fec4f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:51.527773 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-eb4ff216-80aa-4087-9e12-2296b4421b13 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:51.538863 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-eb4ff216-80aa-4087-9e12-2296b4421b13 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:51.540381 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-eb4ff216-80aa-4087-9e12-2296b4421b13 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:51.541485 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-eb4ff216-80aa-4087-9e12-2296b4421b13 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1406 microversion: 2.20 time: 0.341692 Aug 27 01:30:51.542656 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 59/113] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:30:51 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1406 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:30:51.548826 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-77504126-6f5a-4b25-a91f-3dd7c560bd9d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:51.551179 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-77504126-6f5a-4b25-a91f-3dd7c560bd9d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:51.558416 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-77504126-6f5a-4b25-a91f-3dd7c560bd9d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:51.559279 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-77504126-6f5a-4b25-a91f-3dd7c560bd9d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:51.560434 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-77504126-6f5a-4b25-a91f-3dd7c560bd9d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:51.561447 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-77504126-6f5a-4b25-a91f-3dd7c560bd9d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:51.594033 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-5243438d-fa6a-447d-96c1-ef1c3d5fec4f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:51.606165 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-5243438d-fa6a-447d-96c1-ef1c3d5fec4f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1322 microversion: 2.1 time: 0.171287 Aug 27 01:30:51.606750 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 55/114] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:51 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:51.718818 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-77504126-6f5a-4b25-a91f-3dd7c560bd9d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:51.721815 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-04def852-f8b0-4f89-a876-4b65aa0fd786 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:51.722419 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-04def852-f8b0-4f89-a876-4b65aa0fd786 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:51.727562 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-77504126-6f5a-4b25-a91f-3dd7c560bd9d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1362 microversion: 2.1 time: 0.183616 Aug 27 01:30:51.728128 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 60/115] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:51 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:51.728902 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-04def852-f8b0-4f89-a876-4b65aa0fd786 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:51.729416 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-04def852-f8b0-4f89-a876-4b65aa0fd786 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:51.730249 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-04def852-f8b0-4f89-a876-4b65aa0fd786 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:51.730782 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-04def852-f8b0-4f89-a876-4b65aa0fd786 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:51.855418 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-04def852-f8b0-4f89-a876-4b65aa0fd786 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:51.862667 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-04def852-f8b0-4f89-a876-4b65aa0fd786 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 0.144419 Aug 27 01:30:51.863219 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 56/116] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:51 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:52.450325 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-f9f4878c-8cc0-4c2d-905f-2ea27d86f203 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:52.451053 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-f9f4878c-8cc0-4c2d-905f-2ea27d86f203 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:52.456931 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f9f4878c-8cc0-4c2d-905f-2ea27d86f203 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:52.457375 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f9f4878c-8cc0-4c2d-905f-2ea27d86f203 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:52.458134 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f9f4878c-8cc0-4c2d-905f-2ea27d86f203 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:52.458565 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f9f4878c-8cc0-4c2d-905f-2ea27d86f203 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:52.562133 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-8b0fe587-aabc-480d-852e-b513789c7e38 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:52.562742 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-8b0fe587-aabc-480d-852e-b513789c7e38 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:52.568930 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8b0fe587-aabc-480d-852e-b513789c7e38 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:52.569648 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8b0fe587-aabc-480d-852e-b513789c7e38 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:52.570632 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8b0fe587-aabc-480d-852e-b513789c7e38 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:52.571068 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8b0fe587-aabc-480d-852e-b513789c7e38 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:52.585875 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-f9f4878c-8cc0-4c2d-905f-2ea27d86f203 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:52.597275 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-f9f4878c-8cc0-4c2d-905f-2ea27d86f203 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.149912 Aug 27 01:30:52.598676 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 61/117] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:52 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:52.623974 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4467a281-d571-4627-a96b-b7cc92d2c252 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:52.624665 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4467a281-d571-4627-a96b-b7cc92d2c252 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:52.630751 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4467a281-d571-4627-a96b-b7cc92d2c252 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:52.631272 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4467a281-d571-4627-a96b-b7cc92d2c252 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:52.632042 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4467a281-d571-4627-a96b-b7cc92d2c252 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:52.632475 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4467a281-d571-4627-a96b-b7cc92d2c252 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:52.772368 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4467a281-d571-4627-a96b-b7cc92d2c252 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:52.780635 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4467a281-d571-4627-a96b-b7cc92d2c252 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1322 microversion: 2.1 time: 0.160441 Aug 27 01:30:52.781613 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 62/118] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:52 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:30:52.786071 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-e30f95f8-0cb5-4001-a70b-b14a66abe422 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:52.786755 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-e30f95f8-0cb5-4001-a70b-b14a66abe422 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:52.796665 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e30f95f8-0cb5-4001-a70b-b14a66abe422 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:52.796665 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e30f95f8-0cb5-4001-a70b-b14a66abe422 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:52.796665 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e30f95f8-0cb5-4001-a70b-b14a66abe422 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:52.796665 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e30f95f8-0cb5-4001-a70b-b14a66abe422 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:52.810073 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-8b0fe587-aabc-480d-852e-b513789c7e38 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:52.818011 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-8b0fe587-aabc-480d-852e-b513789c7e38 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:52.819525 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-8b0fe587-aabc-480d-852e-b513789c7e38 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:52.820628 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-8b0fe587-aabc-480d-852e-b513789c7e38 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1406 microversion: 2.20 time: 0.262576 Aug 27 01:30:52.821258 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 57/119] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:30:52 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1406 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:30:52.880434 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-952bf79a-f4c2-4478-b148-bd53864a7aa8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:52.881061 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-952bf79a-f4c2-4478-b148-bd53864a7aa8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:52.886899 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-952bf79a-f4c2-4478-b148-bd53864a7aa8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:52.887653 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-952bf79a-f4c2-4478-b148-bd53864a7aa8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:52.889048 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-952bf79a-f4c2-4478-b148-bd53864a7aa8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:52.889487 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-952bf79a-f4c2-4478-b148-bd53864a7aa8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:52.915106 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-e30f95f8-0cb5-4001-a70b-b14a66abe422 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:52.922579 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-e30f95f8-0cb5-4001-a70b-b14a66abe422 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1362 microversion: 2.1 time: 0.139804 Aug 27 01:30:52.923140 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 63/120] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:52 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1362 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:53.006807 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-952bf79a-f4c2-4478-b148-bd53864a7aa8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:53.015020 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-952bf79a-f4c2-4478-b148-bd53864a7aa8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 0.138109 Aug 27 01:30:53.015839 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 58/121] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:52 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:30:53.615513 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-5659b360-d13c-4b59-8f50-3541744d6cb0 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:53.616100 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-5659b360-d13c-4b59-8f50-3541744d6cb0 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:53.621885 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5659b360-d13c-4b59-8f50-3541744d6cb0 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:53.622329 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5659b360-d13c-4b59-8f50-3541744d6cb0 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:53.623082 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5659b360-d13c-4b59-8f50-3541744d6cb0 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:53.623517 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5659b360-d13c-4b59-8f50-3541744d6cb0 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:53.744406 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-5659b360-d13c-4b59-8f50-3541744d6cb0 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:53.752179 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-5659b360-d13c-4b59-8f50-3541744d6cb0 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.140456 Aug 27 01:30:53.752740 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 64/122] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:53 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:53.798694 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-42b79dcc-d67e-4b08-95f8-1026ea4896f3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:53.799136 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-42b79dcc-d67e-4b08-95f8-1026ea4896f3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:53.804732 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-42b79dcc-d67e-4b08-95f8-1026ea4896f3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:53.805216 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-42b79dcc-d67e-4b08-95f8-1026ea4896f3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:53.808645 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-42b79dcc-d67e-4b08-95f8-1026ea4896f3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:53.808645 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-42b79dcc-d67e-4b08-95f8-1026ea4896f3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:53.839445 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d31009e7-08af-4e07-b978-8e271c9ed546 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:53.840342 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d31009e7-08af-4e07-b978-8e271c9ed546 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:53.847295 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d31009e7-08af-4e07-b978-8e271c9ed546 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:53.847802 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d31009e7-08af-4e07-b978-8e271c9ed546 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:53.848580 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d31009e7-08af-4e07-b978-8e271c9ed546 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:53.849061 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d31009e7-08af-4e07-b978-8e271c9ed546 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:53.927656 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-42b79dcc-d67e-4b08-95f8-1026ea4896f3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:53.935271 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-42b79dcc-d67e-4b08-95f8-1026ea4896f3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1322 microversion: 2.1 time: 0.141388 Aug 27 01:30:53.935897 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 59/123] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:53 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1322 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:53.940745 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-4f6ebe18-c68f-4c5b-90ef-3ea9784a545f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:53.941560 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-4f6ebe18-c68f-4c5b-90ef-3ea9784a545f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:53.947801 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4f6ebe18-c68f-4c5b-90ef-3ea9784a545f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:53.948321 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4f6ebe18-c68f-4c5b-90ef-3ea9784a545f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:53.949113 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4f6ebe18-c68f-4c5b-90ef-3ea9784a545f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:53.949540 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4f6ebe18-c68f-4c5b-90ef-3ea9784a545f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:53.976550 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d31009e7-08af-4e07-b978-8e271c9ed546 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:53.984381 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d31009e7-08af-4e07-b978-8e271c9ed546 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:53.985934 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d31009e7-08af-4e07-b978-8e271c9ed546 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:53.987017 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d31009e7-08af-4e07-b978-8e271c9ed546 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1406 microversion: 2.20 time: 0.151254 Aug 27 01:30:53.987561 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 65/124] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:30:53 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:30:54.031770 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-c2b8343c-45fa-4480-9364-d47faf2cb16c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:54.032383 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-c2b8343c-45fa-4480-9364-d47faf2cb16c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:54.038323 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c2b8343c-45fa-4480-9364-d47faf2cb16c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:54.038767 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c2b8343c-45fa-4480-9364-d47faf2cb16c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:54.039527 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c2b8343c-45fa-4480-9364-d47faf2cb16c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:54.039952 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c2b8343c-45fa-4480-9364-d47faf2cb16c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:54.073935 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-4f6ebe18-c68f-4c5b-90ef-3ea9784a545f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:54.083042 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-4f6ebe18-c68f-4c5b-90ef-3ea9784a545f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1362 microversion: 2.1 time: 0.145771 Aug 27 01:30:54.083718 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 60/125] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:53 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:54.162202 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-c2b8343c-45fa-4480-9364-d47faf2cb16c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:54.169468 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-c2b8343c-45fa-4480-9364-d47faf2cb16c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 0.141511 Aug 27 01:30:54.170027 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 66/126] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:54 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:30:54.768596 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-1de7f750-cb7b-4970-a9f9-805bf1bcb946 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:54.769245 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-1de7f750-cb7b-4970-a9f9-805bf1bcb946 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:54.779326 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1de7f750-cb7b-4970-a9f9-805bf1bcb946 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:54.780046 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1de7f750-cb7b-4970-a9f9-805bf1bcb946 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:54.781664 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1de7f750-cb7b-4970-a9f9-805bf1bcb946 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:54.782291 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1de7f750-cb7b-4970-a9f9-805bf1bcb946 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:54.951687 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4f5bdbe5-d321-48a1-9e69-89bc6e89e153 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:54.952980 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4f5bdbe5-d321-48a1-9e69-89bc6e89e153 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:54.959819 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4f5bdbe5-d321-48a1-9e69-89bc6e89e153 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:54.963468 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4f5bdbe5-d321-48a1-9e69-89bc6e89e153 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:54.963468 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4f5bdbe5-d321-48a1-9e69-89bc6e89e153 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:54.963468 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4f5bdbe5-d321-48a1-9e69-89bc6e89e153 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:55.024337 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-1de7f750-cb7b-4970-a9f9-805bf1bcb946 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:55.033446 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-1de7f750-cb7b-4970-a9f9-805bf1bcb946 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.268007 Aug 27 01:30:55.035509 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 61/127] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:54 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:55.041520 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ab2fb55d-9f0d-4640-a725-1dbde4ef4539 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:55.043058 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-ab2fb55d-9f0d-4640-a725-1dbde4ef4539 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:55.049709 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ab2fb55d-9f0d-4640-a725-1dbde4ef4539 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:55.050243 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ab2fb55d-9f0d-4640-a725-1dbde4ef4539 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:55.051097 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ab2fb55d-9f0d-4640-a725-1dbde4ef4539 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:55.051733 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ab2fb55d-9f0d-4640-a725-1dbde4ef4539 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:55.111060 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4f5bdbe5-d321-48a1-9e69-89bc6e89e153 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:55.124507 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4f5bdbe5-d321-48a1-9e69-89bc6e89e153 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1322 microversion: 2.1 time: 0.176139 Aug 27 01:30:55.125124 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 67/128] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:54 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:30:55.130126 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-5fd2f866-0834-4b72-9b20-6d49126e1753 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:55.131043 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-5fd2f866-0834-4b72-9b20-6d49126e1753 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:55.138053 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5fd2f866-0834-4b72-9b20-6d49126e1753 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:55.138760 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5fd2f866-0834-4b72-9b20-6d49126e1753 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:55.140611 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5fd2f866-0834-4b72-9b20-6d49126e1753 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:55.141151 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5fd2f866-0834-4b72-9b20-6d49126e1753 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:55.272656 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-5fd2f866-0834-4b72-9b20-6d49126e1753 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:55.281219 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-5fd2f866-0834-4b72-9b20-6d49126e1753 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1362 microversion: 2.1 time: 0.153648 Aug 27 01:30:55.281943 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 68/129] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:55 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:55.287634 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-0cf6117e-7c43-4f60-8ca3-739d429e76f0 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:55.288598 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-0cf6117e-7c43-4f60-8ca3-739d429e76f0 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:55.300084 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0cf6117e-7c43-4f60-8ca3-739d429e76f0 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:55.300617 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0cf6117e-7c43-4f60-8ca3-739d429e76f0 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:55.301641 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0cf6117e-7c43-4f60-8ca3-739d429e76f0 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:55.303070 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0cf6117e-7c43-4f60-8ca3-739d429e76f0 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:55.404502 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ab2fb55d-9f0d-4640-a725-1dbde4ef4539 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:55.417358 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ab2fb55d-9f0d-4640-a725-1dbde4ef4539 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:55.417358 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ab2fb55d-9f0d-4640-a725-1dbde4ef4539 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:55.417889 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-ab2fb55d-9f0d-4640-a725-1dbde4ef4539 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1406 microversion: 2.20 time: 0.381092 Aug 27 01:30:55.429872 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 62/130] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:30:55 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1406 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:30:55.470012 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-0cf6117e-7c43-4f60-8ca3-739d429e76f0 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:55.477132 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-0cf6117e-7c43-4f60-8ca3-739d429e76f0 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 0.193733 Aug 27 01:30:55.477695 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 69/131] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:55 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:56.051746 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-e6bb3289-6e74-4703-9959-f99100e9d17c tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:56.052268 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-e6bb3289-6e74-4703-9959-f99100e9d17c tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:56.058577 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e6bb3289-6e74-4703-9959-f99100e9d17c tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:56.059045 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e6bb3289-6e74-4703-9959-f99100e9d17c tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:56.059835 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e6bb3289-6e74-4703-9959-f99100e9d17c tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:56.060261 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e6bb3289-6e74-4703-9959-f99100e9d17c tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:56.141113 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-6af68f50-9e7e-419c-aaa7-2040dea8e673 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:56.141818 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-6af68f50-9e7e-419c-aaa7-2040dea8e673 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:56.147688 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6af68f50-9e7e-419c-aaa7-2040dea8e673 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:56.148127 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6af68f50-9e7e-419c-aaa7-2040dea8e673 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:56.148906 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6af68f50-9e7e-419c-aaa7-2040dea8e673 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:56.149334 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6af68f50-9e7e-419c-aaa7-2040dea8e673 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:56.184524 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-e6bb3289-6e74-4703-9959-f99100e9d17c tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:56.191702 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-e6bb3289-6e74-4703-9959-f99100e9d17c tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.143605 Aug 27 01:30:56.192255 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 63/132] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:56 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:56.272657 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-6af68f50-9e7e-419c-aaa7-2040dea8e673 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:56.279824 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-6af68f50-9e7e-419c-aaa7-2040dea8e673 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1322 microversion: 2.1 time: 0.142462 Aug 27 01:30:56.280515 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 70/133] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:56 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1322 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:30:56.298602 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-991cc579-73df-44e9-844e-59f30edab44a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:56.306561 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-991cc579-73df-44e9-844e-59f30edab44a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:56.306561 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-991cc579-73df-44e9-844e-59f30edab44a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:56.306561 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-991cc579-73df-44e9-844e-59f30edab44a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:56.306561 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-991cc579-73df-44e9-844e-59f30edab44a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:56.306956 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-991cc579-73df-44e9-844e-59f30edab44a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:56.426007 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-991cc579-73df-44e9-844e-59f30edab44a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:56.433762 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-991cc579-73df-44e9-844e-59f30edab44a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1362 microversion: 2.1 time: 0.139353 Aug 27 01:30:56.434318 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 64/134] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:56 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1362 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:56.436447 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-8edd70fe-0225-466d-bcdf-81d22bb76dee tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:56.437311 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-8edd70fe-0225-466d-bcdf-81d22bb76dee tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:56.443263 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8edd70fe-0225-466d-bcdf-81d22bb76dee tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:56.443791 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8edd70fe-0225-466d-bcdf-81d22bb76dee tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:56.444541 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8edd70fe-0225-466d-bcdf-81d22bb76dee tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:56.444996 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8edd70fe-0225-466d-bcdf-81d22bb76dee tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:56.493728 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-6eb48cc3-e656-42a7-9490-ca7a3ba0cfbd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:56.494450 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-6eb48cc3-e656-42a7-9490-ca7a3ba0cfbd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:56.500427 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6eb48cc3-e656-42a7-9490-ca7a3ba0cfbd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:56.500901 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6eb48cc3-e656-42a7-9490-ca7a3ba0cfbd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:56.501658 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6eb48cc3-e656-42a7-9490-ca7a3ba0cfbd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:56.502171 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6eb48cc3-e656-42a7-9490-ca7a3ba0cfbd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:56.565400 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-8edd70fe-0225-466d-bcdf-81d22bb76dee tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:56.573961 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-8edd70fe-0225-466d-bcdf-81d22bb76dee tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:56.575523 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-8edd70fe-0225-466d-bcdf-81d22bb76dee tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:56.576640 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-8edd70fe-0225-466d-bcdf-81d22bb76dee tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1406 microversion: 2.20 time: 0.143798 Aug 27 01:30:56.577753 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 71/135] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:30:56 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1406 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:30:56.627785 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-6eb48cc3-e656-42a7-9490-ca7a3ba0cfbd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:56.635196 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-6eb48cc3-e656-42a7-9490-ca7a3ba0cfbd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 0.145071 Aug 27 01:30:56.635759 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 65/136] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:56 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:30:57.208001 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-873519f7-32b3-427f-aa43-7b62f3a040b7 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:57.208973 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-873519f7-32b3-427f-aa43-7b62f3a040b7 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:57.215086 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-873519f7-32b3-427f-aa43-7b62f3a040b7 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:57.215601 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-873519f7-32b3-427f-aa43-7b62f3a040b7 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:57.216304 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-873519f7-32b3-427f-aa43-7b62f3a040b7 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:57.216756 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-873519f7-32b3-427f-aa43-7b62f3a040b7 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:57.297860 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ee5e819b-8bfe-4c3d-87bc-53aaea3e9c6a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:57.298465 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-ee5e819b-8bfe-4c3d-87bc-53aaea3e9c6a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:57.304338 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ee5e819b-8bfe-4c3d-87bc-53aaea3e9c6a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:57.304781 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ee5e819b-8bfe-4c3d-87bc-53aaea3e9c6a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:57.305570 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ee5e819b-8bfe-4c3d-87bc-53aaea3e9c6a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:57.306268 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ee5e819b-8bfe-4c3d-87bc-53aaea3e9c6a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:57.337634 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-873519f7-32b3-427f-aa43-7b62f3a040b7 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:57.345801 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-873519f7-32b3-427f-aa43-7b62f3a040b7 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.141429 Aug 27 01:30:57.346375 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 72/137] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:57 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:57.429733 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ee5e819b-8bfe-4c3d-87bc-53aaea3e9c6a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:57.437564 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-ee5e819b-8bfe-4c3d-87bc-53aaea3e9c6a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1322 microversion: 2.1 time: 0.143745 Aug 27 01:30:57.438117 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 66/138] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:57 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:30:57.449163 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-7f642bec-1bd3-4fc5-b422-27ccf3d4e0fe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:57.449771 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-7f642bec-1bd3-4fc5-b422-27ccf3d4e0fe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:57.455651 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7f642bec-1bd3-4fc5-b422-27ccf3d4e0fe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:57.456094 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7f642bec-1bd3-4fc5-b422-27ccf3d4e0fe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:57.456867 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7f642bec-1bd3-4fc5-b422-27ccf3d4e0fe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:57.457291 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7f642bec-1bd3-4fc5-b422-27ccf3d4e0fe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:57.576561 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-7f642bec-1bd3-4fc5-b422-27ccf3d4e0fe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:57.583727 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-7f642bec-1bd3-4fc5-b422-27ccf3d4e0fe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1362 microversion: 2.1 time: 0.138153 Aug 27 01:30:57.584279 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 73/139] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:57 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1362 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:57.594494 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c3a45cd3-6f95-4205-ab05-9f47ad2259a1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:57.595092 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c3a45cd3-6f95-4205-ab05-9f47ad2259a1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:57.601005 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c3a45cd3-6f95-4205-ab05-9f47ad2259a1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:57.601446 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c3a45cd3-6f95-4205-ab05-9f47ad2259a1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:57.603311 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c3a45cd3-6f95-4205-ab05-9f47ad2259a1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:57.603743 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c3a45cd3-6f95-4205-ab05-9f47ad2259a1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:57.662457 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-6e374aec-d3cd-4166-99c4-06b1084efd39 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:57.663061 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-6e374aec-d3cd-4166-99c4-06b1084efd39 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:57.669423 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6e374aec-d3cd-4166-99c4-06b1084efd39 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:57.669813 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6e374aec-d3cd-4166-99c4-06b1084efd39 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:57.670574 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6e374aec-d3cd-4166-99c4-06b1084efd39 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:57.671576 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6e374aec-d3cd-4166-99c4-06b1084efd39 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:57.724694 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c3a45cd3-6f95-4205-ab05-9f47ad2259a1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:57.732702 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c3a45cd3-6f95-4205-ab05-9f47ad2259a1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:57.734947 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c3a45cd3-6f95-4205-ab05-9f47ad2259a1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:57.742572 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c3a45cd3-6f95-4205-ab05-9f47ad2259a1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1406 microversion: 2.20 time: 0.145671 Aug 27 01:30:57.742572 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 67/140] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:30:57 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1406 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:30:57.789399 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-6e374aec-d3cd-4166-99c4-06b1084efd39 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:57.797087 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-6e374aec-d3cd-4166-99c4-06b1084efd39 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 0.138258 Aug 27 01:30:57.797636 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 74/141] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:57 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:30:58.362339 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-4e2f6581-3801-4e3a-96d7-bad8a67d5f29 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:58.363054 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-4e2f6581-3801-4e3a-96d7-bad8a67d5f29 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:58.369034 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4e2f6581-3801-4e3a-96d7-bad8a67d5f29 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:58.369475 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4e2f6581-3801-4e3a-96d7-bad8a67d5f29 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:58.370237 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4e2f6581-3801-4e3a-96d7-bad8a67d5f29 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:58.370663 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4e2f6581-3801-4e3a-96d7-bad8a67d5f29 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:58.454509 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-f6dcbaeb-95dd-4349-b338-44bbb9b211ac tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:58.455123 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-f6dcbaeb-95dd-4349-b338-44bbb9b211ac tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:58.461016 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f6dcbaeb-95dd-4349-b338-44bbb9b211ac tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:58.461459 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f6dcbaeb-95dd-4349-b338-44bbb9b211ac tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:58.462242 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f6dcbaeb-95dd-4349-b338-44bbb9b211ac tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:58.462828 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f6dcbaeb-95dd-4349-b338-44bbb9b211ac tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:58.497569 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-4e2f6581-3801-4e3a-96d7-bad8a67d5f29 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:58.505306 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-4e2f6581-3801-4e3a-96d7-bad8a67d5f29 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.146756 Aug 27 01:30:58.505866 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 68/142] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:58 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:58.584743 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-f6dcbaeb-95dd-4349-b338-44bbb9b211ac tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:58.591956 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-f6dcbaeb-95dd-4349-b338-44bbb9b211ac tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1322 microversion: 2.1 time: 0.141682 Aug 27 01:30:58.592655 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 75/143] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:58 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1322 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:30:58.600242 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-1b8c26fb-67d3-4a77-8608-a6caca563c11 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:58.600861 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-1b8c26fb-67d3-4a77-8608-a6caca563c11 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:58.606959 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1b8c26fb-67d3-4a77-8608-a6caca563c11 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:58.607399 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1b8c26fb-67d3-4a77-8608-a6caca563c11 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:58.608149 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1b8c26fb-67d3-4a77-8608-a6caca563c11 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:58.609410 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1b8c26fb-67d3-4a77-8608-a6caca563c11 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:58.730749 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-1b8c26fb-67d3-4a77-8608-a6caca563c11 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:58.738695 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-1b8c26fb-67d3-4a77-8608-a6caca563c11 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1362 microversion: 2.1 time: 0.142144 Aug 27 01:30:58.739253 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 69/144] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:58 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1362 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:58.753946 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-65101872-b2fc-4871-985b-b183fb388740 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:58.754550 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-65101872-b2fc-4871-985b-b183fb388740 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:58.760241 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-65101872-b2fc-4871-985b-b183fb388740 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:58.760673 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-65101872-b2fc-4871-985b-b183fb388740 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:58.761453 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-65101872-b2fc-4871-985b-b183fb388740 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:58.761883 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-65101872-b2fc-4871-985b-b183fb388740 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:58.814415 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-dd997725-d31a-47c0-9be9-3c1c471a2d50 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:58.815020 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-dd997725-d31a-47c0-9be9-3c1c471a2d50 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:58.821054 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-dd997725-d31a-47c0-9be9-3c1c471a2d50 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:58.824480 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-dd997725-d31a-47c0-9be9-3c1c471a2d50 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:58.824480 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-dd997725-d31a-47c0-9be9-3c1c471a2d50 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:58.824480 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-dd997725-d31a-47c0-9be9-3c1c471a2d50 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:58.887624 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-65101872-b2fc-4871-985b-b183fb388740 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:58.896249 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-65101872-b2fc-4871-985b-b183fb388740 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:58.897768 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-65101872-b2fc-4871-985b-b183fb388740 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:58.898842 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-65101872-b2fc-4871-985b-b183fb388740 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1406 microversion: 2.20 time: 0.148515 Aug 27 01:30:58.899408 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 76/145] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:30:58 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:30:58.949167 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-dd997725-d31a-47c0-9be9-3c1c471a2d50 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:58.956607 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-dd997725-d31a-47c0-9be9-3c1c471a2d50 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 0.146385 Aug 27 01:30:58.957202 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 70/146] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:58 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:30:59.524483 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c1e7ea53-bf4c-4885-ba73-57ed12711f81 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:59.526078 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c1e7ea53-bf4c-4885-ba73-57ed12711f81 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:59.533045 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c1e7ea53-bf4c-4885-ba73-57ed12711f81 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:59.533681 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c1e7ea53-bf4c-4885-ba73-57ed12711f81 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:59.534516 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c1e7ea53-bf4c-4885-ba73-57ed12711f81 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:59.534945 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c1e7ea53-bf4c-4885-ba73-57ed12711f81 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:59.559643 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-6481d282-773e-4b0d-91e8-1d5ed6358dea req-7d8bf4f8-6951-4a92-b1e1-01f9cd435add service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be807b17-abdc-4d79-b58d-b42998cdb479", "name": "network-vif-plugged", "status": "completed", "tag": "f18d8c2b-ab08-4402-a440-92bdcf75c38a"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:30:59.561348 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:30:59.561348 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:30:59.568232 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-6481d282-773e-4b0d-91e8-1d5ed6358dea req-7d8bf4f8-6951-4a92-b1e1-01f9cd435add service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:59.568672 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-6481d282-773e-4b0d-91e8-1d5ed6358dea req-7d8bf4f8-6951-4a92-b1e1-01f9cd435add service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:59.580479 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-6481d282-773e-4b0d-91e8-1d5ed6358dea req-7d8bf4f8-6951-4a92-b1e1-01f9cd435add service nova] Creating event network-vif-plugged:f18d8c2b-ab08-4402-a440-92bdcf75c38a for instance be807b17-abdc-4d79-b58d-b42998cdb479 on hv-cinder-75916 Aug 27 01:30:59.586210 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-6481d282-773e-4b0d-91e8-1d5ed6358dea req-7d8bf4f8-6951-4a92-b1e1-01f9cd435add service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100570 Aug 27 01:30:59.587132 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 77/147] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:30:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:30:59.609499 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-2b79d08e-b455-402c-a577-d109e1a6bbd2 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:59.610188 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-2b79d08e-b455-402c-a577-d109e1a6bbd2 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:59.616356 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2b79d08e-b455-402c-a577-d109e1a6bbd2 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:59.616804 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2b79d08e-b455-402c-a577-d109e1a6bbd2 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:59.617585 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2b79d08e-b455-402c-a577-d109e1a6bbd2 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:59.618009 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2b79d08e-b455-402c-a577-d109e1a6bbd2 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:59.678962 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c1e7ea53-bf4c-4885-ba73-57ed12711f81 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:59.687632 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c1e7ea53-bf4c-4885-ba73-57ed12711f81 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.168218 Aug 27 01:30:59.690723 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 71/148] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:59 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:30:59.756069 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-30799238-c562-4c36-ad87-b186a11be0c4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:59.756894 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-30799238-c562-4c36-ad87-b186a11be0c4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:59.763633 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-30799238-c562-4c36-ad87-b186a11be0c4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:59.764463 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-30799238-c562-4c36-ad87-b186a11be0c4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:59.764906 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-30799238-c562-4c36-ad87-b186a11be0c4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:59.765558 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-30799238-c562-4c36-ad87-b186a11be0c4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:59.772998 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-2b79d08e-b455-402c-a577-d109e1a6bbd2 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:59.781605 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-2b79d08e-b455-402c-a577-d109e1a6bbd2 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1322 microversion: 2.1 time: 0.175716 Aug 27 01:30:59.782467 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 78/149] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:59 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:30:59.916713 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4990518f-6b3b-42ee-9e79-4bb51521f11b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:59.917599 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4990518f-6b3b-42ee-9e79-4bb51521f11b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:59.924719 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4990518f-6b3b-42ee-9e79-4bb51521f11b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:59.925608 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4990518f-6b3b-42ee-9e79-4bb51521f11b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:59.926149 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4990518f-6b3b-42ee-9e79-4bb51521f11b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:59.926877 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4990518f-6b3b-42ee-9e79-4bb51521f11b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:59.930044 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-30799238-c562-4c36-ad87-b186a11be0c4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:30:59.939755 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-30799238-c562-4c36-ad87-b186a11be0c4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1362 microversion: 2.1 time: 0.187426 Aug 27 01:30:59.955238 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 72/150] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:59 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:30:59.978015 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-2c52e044-4119-44ce-b2e8-264328d37e43 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:30:59.982961 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-2c52e044-4119-44ce-b2e8-264328d37e43 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:30:59.990955 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2c52e044-4119-44ce-b2e8-264328d37e43 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:59.991629 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2c52e044-4119-44ce-b2e8-264328d37e43 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:30:59.992565 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2c52e044-4119-44ce-b2e8-264328d37e43 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:30:59.993168 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2c52e044-4119-44ce-b2e8-264328d37e43 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:00.091154 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4990518f-6b3b-42ee-9e79-4bb51521f11b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:00.101497 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4990518f-6b3b-42ee-9e79-4bb51521f11b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:00.104198 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4990518f-6b3b-42ee-9e79-4bb51521f11b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:00.105864 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4990518f-6b3b-42ee-9e79-4bb51521f11b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1406 microversion: 2.20 time: 0.193137 Aug 27 01:31:00.106882 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 79/151] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:30:59 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:31:00.260706 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-2c52e044-4119-44ce-b2e8-264328d37e43 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:00.268218 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-2c52e044-4119-44ce-b2e8-264328d37e43 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 0.299035 Aug 27 01:31:00.269036 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 73/152] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:30:59 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:00.704171 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d58e7e5a-8dfd-4db4-bf6d-ca0d73d168f0 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:00.705478 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d58e7e5a-8dfd-4db4-bf6d-ca0d73d168f0 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:00.711410 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d58e7e5a-8dfd-4db4-bf6d-ca0d73d168f0 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:00.711858 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d58e7e5a-8dfd-4db4-bf6d-ca0d73d168f0 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:00.712617 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d58e7e5a-8dfd-4db4-bf6d-ca0d73d168f0 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:00.713072 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d58e7e5a-8dfd-4db4-bf6d-ca0d73d168f0 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:00.799487 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c05850aa-e6a2-4556-ba77-c49f487238ca tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:00.800093 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c05850aa-e6a2-4556-ba77-c49f487238ca tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:00.806433 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c05850aa-e6a2-4556-ba77-c49f487238ca tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:00.806876 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c05850aa-e6a2-4556-ba77-c49f487238ca tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:00.807737 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c05850aa-e6a2-4556-ba77-c49f487238ca tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:00.808173 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c05850aa-e6a2-4556-ba77-c49f487238ca tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:00.838563 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d58e7e5a-8dfd-4db4-bf6d-ca0d73d168f0 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:00.846591 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d58e7e5a-8dfd-4db4-bf6d-ca0d73d168f0 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.147078 Aug 27 01:31:00.847167 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 80/153] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:00 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:00.928996 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c05850aa-e6a2-4556-ba77-c49f487238ca tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:00.936415 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c05850aa-e6a2-4556-ba77-c49f487238ca tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1322 microversion: 2.1 time: 0.141477 Aug 27 01:31:00.937021 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 74/154] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:00 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1322 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:00.962372 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-5e23d199-4026-4cb0-9310-ac9e30b94d4e tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:00.962975 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-5e23d199-4026-4cb0-9310-ac9e30b94d4e tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:00.969321 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5e23d199-4026-4cb0-9310-ac9e30b94d4e tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:00.969757 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5e23d199-4026-4cb0-9310-ac9e30b94d4e tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:00.970954 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5e23d199-4026-4cb0-9310-ac9e30b94d4e tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:00.971381 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5e23d199-4026-4cb0-9310-ac9e30b94d4e tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:01.090858 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-5e23d199-4026-4cb0-9310-ac9e30b94d4e tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:01.098860 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-5e23d199-4026-4cb0-9310-ac9e30b94d4e tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1362 microversion: 2.1 time: 0.140268 Aug 27 01:31:01.099414 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 81/155] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:00 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1362 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:01.123085 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-1365c6c5-c9bc-4c6a-88f8-f46a4532cc95 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:01.123688 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-1365c6c5-c9bc-4c6a-88f8-f46a4532cc95 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:01.129559 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1365c6c5-c9bc-4c6a-88f8-f46a4532cc95 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:01.130000 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1365c6c5-c9bc-4c6a-88f8-f46a4532cc95 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:01.130753 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1365c6c5-c9bc-4c6a-88f8-f46a4532cc95 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:01.131180 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1365c6c5-c9bc-4c6a-88f8-f46a4532cc95 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:01.274661 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-1365c6c5-c9bc-4c6a-88f8-f46a4532cc95 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:01.288038 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-5c222471-5f63-4c5e-bda8-d17c3d7891d8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:01.288552 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-5c222471-5f63-4c5e-bda8-d17c3d7891d8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:01.294758 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5c222471-5f63-4c5e-bda8-d17c3d7891d8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:01.295467 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5c222471-5f63-4c5e-bda8-d17c3d7891d8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:01.297149 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5c222471-5f63-4c5e-bda8-d17c3d7891d8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:01.297600 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5c222471-5f63-4c5e-bda8-d17c3d7891d8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:01.301305 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-1365c6c5-c9bc-4c6a-88f8-f46a4532cc95 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:01.304387 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-1365c6c5-c9bc-4c6a-88f8-f46a4532cc95 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:01.306938 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-1365c6c5-c9bc-4c6a-88f8-f46a4532cc95 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1406 microversion: 2.20 time: 0.187456 Aug 27 01:31:01.308534 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 75/156] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:31:01 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:31:01.453855 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-5c222471-5f63-4c5e-bda8-d17c3d7891d8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:01.461128 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-5c222471-5f63-4c5e-bda8-d17c3d7891d8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 0.178617 Aug 27 01:31:01.461880 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 82/157] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:01 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:01.601203 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-65643b70-7ab1-49d5-bb97-aacee7bd3c4b req-ef8f9c09-f504-45f3-a211-4108effb0723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b401b16-f181-45c2-99c7-73e06eb28974", "name": "network-vif-plugged", "status": "completed", "tag": "2f74abdb-9f0c-4344-b541-0b15dc2c35bc"}, {"server_uuid": "f70206d1-bfb4-4b0a-9215-72f8e06a7c66", "name": "network-vif-plugged", "status": "completed", "tag": "c1d36e2a-bbeb-40d1-84c2-dacc81e5fe3e"}, {"server_uuid": "6f0c2a27-bde3-4d4a-894b-be6dc9ed6118", "name": "network-vif-plugged", "status": "completed", "tag": "0f68a3b4-5d9c-4b17-875e-e3990c07efa7"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:01.606032 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:31:01.606032 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:31:01.612667 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-65643b70-7ab1-49d5-bb97-aacee7bd3c4b req-ef8f9c09-f504-45f3-a211-4108effb0723 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:01.613138 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-65643b70-7ab1-49d5-bb97-aacee7bd3c4b req-ef8f9c09-f504-45f3-a211-4108effb0723 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:01.633231 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-65643b70-7ab1-49d5-bb97-aacee7bd3c4b req-ef8f9c09-f504-45f3-a211-4108effb0723 service nova] Creating event network-vif-plugged:2f74abdb-9f0c-4344-b541-0b15dc2c35bc for instance 9b401b16-f181-45c2-99c7-73e06eb28974 on hv-cinder-75916 Aug 27 01:31:01.633231 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-65643b70-7ab1-49d5-bb97-aacee7bd3c4b req-ef8f9c09-f504-45f3-a211-4108effb0723 service nova] Creating event network-vif-plugged:c1d36e2a-bbeb-40d1-84c2-dacc81e5fe3e for instance f70206d1-bfb4-4b0a-9215-72f8e06a7c66 on hv-cinder-75916 Aug 27 01:31:01.633231 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-65643b70-7ab1-49d5-bb97-aacee7bd3c4b req-ef8f9c09-f504-45f3-a211-4108effb0723 service nova] Creating event network-vif-plugged:0f68a3b4-5d9c-4b17-875e-e3990c07efa7 for instance 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 on hv-cinder-75916 Aug 27 01:31:01.637175 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-65643b70-7ab1-49d5-bb97-aacee7bd3c4b req-ef8f9c09-f504-45f3-a211-4108effb0723 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.039765 Aug 27 01:31:01.638135 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 76/158] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:31:01 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:31:01.863951 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-5901dd11-3528-4b4f-8d10-8d168019b9c9 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:01.864742 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-5901dd11-3528-4b4f-8d10-8d168019b9c9 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:01.872097 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5901dd11-3528-4b4f-8d10-8d168019b9c9 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:01.872544 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5901dd11-3528-4b4f-8d10-8d168019b9c9 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:01.873373 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5901dd11-3528-4b4f-8d10-8d168019b9c9 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:01.873800 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5901dd11-3528-4b4f-8d10-8d168019b9c9 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:01.954144 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-8568f975-f3d1-42a2-868d-f0a8002d4cd9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:01.954870 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-8568f975-f3d1-42a2-868d-f0a8002d4cd9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:01.961197 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8568f975-f3d1-42a2-868d-f0a8002d4cd9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:01.961861 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8568f975-f3d1-42a2-868d-f0a8002d4cd9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:01.962661 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8568f975-f3d1-42a2-868d-f0a8002d4cd9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:01.963131 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8568f975-f3d1-42a2-868d-f0a8002d4cd9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:02.002202 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-5901dd11-3528-4b4f-8d10-8d168019b9c9 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:02.010565 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-5901dd11-3528-4b4f-8d10-8d168019b9c9 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.150464 Aug 27 01:31:02.011466 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 83/159] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:01 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:02.094059 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-8568f975-f3d1-42a2-868d-f0a8002d4cd9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:02.101255 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-8568f975-f3d1-42a2-868d-f0a8002d4cd9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1322 microversion: 2.1 time: 0.151885 Aug 27 01:31:02.101821 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 77/160] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:01 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:02.116823 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-3f542f58-158e-48e0-827e-a4bfbed5b6d3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:02.117635 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-3f542f58-158e-48e0-827e-a4bfbed5b6d3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:02.127692 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3f542f58-158e-48e0-827e-a4bfbed5b6d3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:02.128129 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3f542f58-158e-48e0-827e-a4bfbed5b6d3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:02.128931 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3f542f58-158e-48e0-827e-a4bfbed5b6d3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:02.129360 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3f542f58-158e-48e0-827e-a4bfbed5b6d3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:02.256887 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-3f542f58-158e-48e0-827e-a4bfbed5b6d3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:02.263891 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-3f542f58-158e-48e0-827e-a4bfbed5b6d3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1362 microversion: 2.1 time: 0.152446 Aug 27 01:31:02.264452 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 84/161] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:02 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:02.325107 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-609adbda-6596-4b6b-af39-9552a8f5d28d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:02.325734 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-609adbda-6596-4b6b-af39-9552a8f5d28d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:02.331863 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-609adbda-6596-4b6b-af39-9552a8f5d28d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:02.332313 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-609adbda-6596-4b6b-af39-9552a8f5d28d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:02.333119 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-609adbda-6596-4b6b-af39-9552a8f5d28d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:02.333556 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-609adbda-6596-4b6b-af39-9552a8f5d28d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:02.457275 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-609adbda-6596-4b6b-af39-9552a8f5d28d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:02.464870 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-609adbda-6596-4b6b-af39-9552a8f5d28d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:02.466362 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-609adbda-6596-4b6b-af39-9552a8f5d28d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:02.467425 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-609adbda-6596-4b6b-af39-9552a8f5d28d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1406 microversion: 2.20 time: 0.146038 Aug 27 01:31:02.468036 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 78/162] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:31:02 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1406 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:31:02.478404 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-a6216083-6792-41e4-9d66-7e63f573989f tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:02.479013 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-a6216083-6792-41e4-9d66-7e63f573989f tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:02.486186 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a6216083-6792-41e4-9d66-7e63f573989f tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:02.486620 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a6216083-6792-41e4-9d66-7e63f573989f tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:02.487518 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a6216083-6792-41e4-9d66-7e63f573989f tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:02.488098 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a6216083-6792-41e4-9d66-7e63f573989f tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:02.610443 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-a6216083-6792-41e4-9d66-7e63f573989f tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:02.617518 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-a6216083-6792-41e4-9d66-7e63f573989f tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 0.142798 Aug 27 01:31:02.618069 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 85/163] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:02 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:03.027993 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-30d3065d-986d-4331-8387-bf5071cda3f9 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:03.028509 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-30d3065d-986d-4331-8387-bf5071cda3f9 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:03.034990 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-30d3065d-986d-4331-8387-bf5071cda3f9 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:03.035434 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-30d3065d-986d-4331-8387-bf5071cda3f9 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:03.036187 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-30d3065d-986d-4331-8387-bf5071cda3f9 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:03.036615 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-30d3065d-986d-4331-8387-bf5071cda3f9 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:03.117779 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-ceb56cb1-06db-4985-bc76-8d7d96f6be21 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:03.118378 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-ceb56cb1-06db-4985-bc76-8d7d96f6be21 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:03.124262 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ceb56cb1-06db-4985-bc76-8d7d96f6be21 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:03.124741 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ceb56cb1-06db-4985-bc76-8d7d96f6be21 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:03.125544 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ceb56cb1-06db-4985-bc76-8d7d96f6be21 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:03.125977 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ceb56cb1-06db-4985-bc76-8d7d96f6be21 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:03.166146 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-30d3065d-986d-4331-8387-bf5071cda3f9 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:03.174205 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-30d3065d-986d-4331-8387-bf5071cda3f9 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.149865 Aug 27 01:31:03.174777 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 79/164] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:03 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:03.255237 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-ceb56cb1-06db-4985-bc76-8d7d96f6be21 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:03.263785 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-ceb56cb1-06db-4985-bc76-8d7d96f6be21 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1322 microversion: 2.1 time: 0.149592 Aug 27 01:31:03.264355 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 86/165] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:03 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:03.281075 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-44e03c40-a160-4ae9-9ab1-05ea442e63d8 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:03.281628 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-44e03c40-a160-4ae9-9ab1-05ea442e63d8 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:03.287408 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-44e03c40-a160-4ae9-9ab1-05ea442e63d8 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:03.287857 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-44e03c40-a160-4ae9-9ab1-05ea442e63d8 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:03.288617 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-44e03c40-a160-4ae9-9ab1-05ea442e63d8 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:03.289090 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-44e03c40-a160-4ae9-9ab1-05ea442e63d8 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:03.409066 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-44e03c40-a160-4ae9-9ab1-05ea442e63d8 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:03.416335 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-44e03c40-a160-4ae9-9ab1-05ea442e63d8 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1362 microversion: 2.1 time: 0.139322 Aug 27 01:31:03.416942 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 80/166] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:03 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1362 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:03.485158 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-38ba7776-3eba-47eb-a8c6-f404d93af35c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:03.485755 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-38ba7776-3eba-47eb-a8c6-f404d93af35c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:03.491718 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-38ba7776-3eba-47eb-a8c6-f404d93af35c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:03.492151 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-38ba7776-3eba-47eb-a8c6-f404d93af35c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:03.492919 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-38ba7776-3eba-47eb-a8c6-f404d93af35c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:03.493343 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-38ba7776-3eba-47eb-a8c6-f404d93af35c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:03.618865 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-38ba7776-3eba-47eb-a8c6-f404d93af35c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:03.627404 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-38ba7776-3eba-47eb-a8c6-f404d93af35c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:03.628909 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-38ba7776-3eba-47eb-a8c6-f404d93af35c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:03.629976 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-38ba7776-3eba-47eb-a8c6-f404d93af35c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1406 microversion: 2.20 time: 0.149128 Aug 27 01:31:03.630511 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 87/167] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:31:03 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:31:03.634461 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-afd2368c-b8b4-4870-94bc-6302a72c3c94 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:03.635059 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-afd2368c-b8b4-4870-94bc-6302a72c3c94 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:03.641340 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-afd2368c-b8b4-4870-94bc-6302a72c3c94 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:03.641785 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-afd2368c-b8b4-4870-94bc-6302a72c3c94 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:03.642541 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-afd2368c-b8b4-4870-94bc-6302a72c3c94 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:03.642967 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-afd2368c-b8b4-4870-94bc-6302a72c3c94 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:03.664178 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-113beb76-2a73-409f-be77-106688ecc46e req-deb77c1b-7fa6-48fa-85dd-e1243fc205f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ec83298-8a1e-4edd-be07-4e0592a0ce04", "name": "network-vif-plugged", "status": "completed", "tag": "5f7cab4d-54ba-4757-bb8d-1d2f0a14a90e"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:03.665800 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:31:03.665800 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:31:03.673144 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-113beb76-2a73-409f-be77-106688ecc46e req-deb77c1b-7fa6-48fa-85dd-e1243fc205f8 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:03.673575 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-113beb76-2a73-409f-be77-106688ecc46e req-deb77c1b-7fa6-48fa-85dd-e1243fc205f8 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:03.684637 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-113beb76-2a73-409f-be77-106688ecc46e req-deb77c1b-7fa6-48fa-85dd-e1243fc205f8 service nova] Creating event network-vif-plugged:5f7cab4d-54ba-4757-bb8d-1d2f0a14a90e for instance 6ec83298-8a1e-4edd-be07-4e0592a0ce04 on hv-cinder-75916 Aug 27 01:31:03.692186 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-113beb76-2a73-409f-be77-106688ecc46e req-deb77c1b-7fa6-48fa-85dd-e1243fc205f8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031516 Aug 27 01:31:03.692774 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 88/168] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:31:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:31:03.769037 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-afd2368c-b8b4-4870-94bc-6302a72c3c94 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:03.776238 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-afd2368c-b8b4-4870-94bc-6302a72c3c94 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 0.145318 Aug 27 01:31:03.776789 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 81/169] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:03 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:04.192420 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-82859e90-c522-4cfb-8a5d-91b07eb1f3ac tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:04.193058 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-82859e90-c522-4cfb-8a5d-91b07eb1f3ac tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:04.199101 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-82859e90-c522-4cfb-8a5d-91b07eb1f3ac tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:04.199546 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-82859e90-c522-4cfb-8a5d-91b07eb1f3ac tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:04.200300 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-82859e90-c522-4cfb-8a5d-91b07eb1f3ac tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:04.200732 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-82859e90-c522-4cfb-8a5d-91b07eb1f3ac tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:04.281082 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-78d7267d-1293-4687-91ea-fa68ae7737eb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:04.281697 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-78d7267d-1293-4687-91ea-fa68ae7737eb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:04.287542 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-78d7267d-1293-4687-91ea-fa68ae7737eb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:04.287978 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-78d7267d-1293-4687-91ea-fa68ae7737eb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:04.288732 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-78d7267d-1293-4687-91ea-fa68ae7737eb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:04.289182 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-78d7267d-1293-4687-91ea-fa68ae7737eb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:04.322602 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-82859e90-c522-4cfb-8a5d-91b07eb1f3ac tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:04.331467 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-82859e90-c522-4cfb-8a5d-91b07eb1f3ac tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.142966 Aug 27 01:31:04.332034 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 89/170] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:04 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:04.416972 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-78d7267d-1293-4687-91ea-fa68ae7737eb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:04.426227 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-78d7267d-1293-4687-91ea-fa68ae7737eb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1322 microversion: 2.1 time: 0.149231 Aug 27 01:31:04.436510 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 82/171] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:04 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:04.441586 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-3e219d21-aa45-4447-bd24-3bbaf17ad235 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:04.442198 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-3e219d21-aa45-4447-bd24-3bbaf17ad235 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:04.451082 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3e219d21-aa45-4447-bd24-3bbaf17ad235 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:04.451477 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3e219d21-aa45-4447-bd24-3bbaf17ad235 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:04.453285 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3e219d21-aa45-4447-bd24-3bbaf17ad235 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:04.454426 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3e219d21-aa45-4447-bd24-3bbaf17ad235 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:04.583322 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-3e219d21-aa45-4447-bd24-3bbaf17ad235 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:04.591096 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-3e219d21-aa45-4447-bd24-3bbaf17ad235 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1362 microversion: 2.1 time: 0.153196 Aug 27 01:31:04.594938 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 90/172] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:04 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:04.648842 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-e8b1659d-4c69-4155-89a5-42cc58cd834d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:04.649599 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-e8b1659d-4c69-4155-89a5-42cc58cd834d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:04.656724 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e8b1659d-4c69-4155-89a5-42cc58cd834d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:04.657192 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e8b1659d-4c69-4155-89a5-42cc58cd834d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:04.658169 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e8b1659d-4c69-4155-89a5-42cc58cd834d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:04.658597 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e8b1659d-4c69-4155-89a5-42cc58cd834d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:04.788424 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-e8b1659d-4c69-4155-89a5-42cc58cd834d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:04.794099 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-425d9215-1245-465b-838d-e08ff776f6c4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:04.794966 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-425d9215-1245-465b-838d-e08ff776f6c4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:04.796804 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-e8b1659d-4c69-4155-89a5-42cc58cd834d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:04.798747 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-e8b1659d-4c69-4155-89a5-42cc58cd834d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:04.799646 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-e8b1659d-4c69-4155-89a5-42cc58cd834d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1406 microversion: 2.20 time: 0.155937 Aug 27 01:31:04.800496 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 83/173] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:31:04 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:31:04.803818 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-425d9215-1245-465b-838d-e08ff776f6c4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:04.803818 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-425d9215-1245-465b-838d-e08ff776f6c4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:04.803818 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-425d9215-1245-465b-838d-e08ff776f6c4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:04.804550 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-425d9215-1245-465b-838d-e08ff776f6c4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:04.944650 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-425d9215-1245-465b-838d-e08ff776f6c4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:04.952231 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-425d9215-1245-465b-838d-e08ff776f6c4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 0.163326 Aug 27 01:31:04.952867 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 91/174] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:04 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:05.347938 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-0167afab-8d6b-4533-975c-8446b31187b2 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:05.348535 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-0167afab-8d6b-4533-975c-8446b31187b2 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:05.354395 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0167afab-8d6b-4533-975c-8446b31187b2 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:05.354833 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0167afab-8d6b-4533-975c-8446b31187b2 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:05.355575 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0167afab-8d6b-4533-975c-8446b31187b2 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:05.356004 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0167afab-8d6b-4533-975c-8446b31187b2 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:05.443021 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-43ab7f51-6213-4190-8f0c-47305f08d2c2 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:05.443783 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-43ab7f51-6213-4190-8f0c-47305f08d2c2 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:05.449711 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-43ab7f51-6213-4190-8f0c-47305f08d2c2 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:05.450148 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-43ab7f51-6213-4190-8f0c-47305f08d2c2 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:05.450901 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-43ab7f51-6213-4190-8f0c-47305f08d2c2 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:05.451328 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-43ab7f51-6213-4190-8f0c-47305f08d2c2 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:05.482118 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0167afab-8d6b-4533-975c-8446b31187b2 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:05.490085 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-0167afab-8d6b-4533-975c-8446b31187b2 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.145741 Aug 27 01:31:05.490867 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 84/175] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:05 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:05.570863 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-43ab7f51-6213-4190-8f0c-47305f08d2c2 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:05.578427 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-43ab7f51-6213-4190-8f0c-47305f08d2c2 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1322 microversion: 2.1 time: 0.138994 Aug 27 01:31:05.578975 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 92/176] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:05 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1322 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:05.609207 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-11ee5f40-e48e-4533-ad4d-1fedbdfd465a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:05.609595 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-11ee5f40-e48e-4533-ad4d-1fedbdfd465a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:05.615444 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-11ee5f40-e48e-4533-ad4d-1fedbdfd465a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:05.615889 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-11ee5f40-e48e-4533-ad4d-1fedbdfd465a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:05.616665 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-11ee5f40-e48e-4533-ad4d-1fedbdfd465a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:05.617116 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-11ee5f40-e48e-4533-ad4d-1fedbdfd465a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:05.741141 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-11ee5f40-e48e-4533-ad4d-1fedbdfd465a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:05.748548 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-11ee5f40-e48e-4533-ad4d-1fedbdfd465a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1362 microversion: 2.1 time: 0.143732 Aug 27 01:31:05.749241 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 85/177] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:05 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1362 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:05.818074 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-12c5090e-ee3c-434d-a7d1-76e4943ce038 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:05.818679 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-12c5090e-ee3c-434d-a7d1-76e4943ce038 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:05.824563 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-12c5090e-ee3c-434d-a7d1-76e4943ce038 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:05.825040 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-12c5090e-ee3c-434d-a7d1-76e4943ce038 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:05.825793 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-12c5090e-ee3c-434d-a7d1-76e4943ce038 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:05.826217 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-12c5090e-ee3c-434d-a7d1-76e4943ce038 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:05.956002 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-12c5090e-ee3c-434d-a7d1-76e4943ce038 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:05.964154 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-12c5090e-ee3c-434d-a7d1-76e4943ce038 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:05.965698 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-12c5090e-ee3c-434d-a7d1-76e4943ce038 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:05.966784 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-12c5090e-ee3c-434d-a7d1-76e4943ce038 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1406 microversion: 2.20 time: 0.152583 Aug 27 01:31:05.967325 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 93/178] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:31:05 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:31:05.969318 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-7ca6c17d-513d-41b4-8d8d-09e2defc9766 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:05.969920 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-7ca6c17d-513d-41b4-8d8d-09e2defc9766 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:05.977573 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7ca6c17d-513d-41b4-8d8d-09e2defc9766 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:05.978016 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7ca6c17d-513d-41b4-8d8d-09e2defc9766 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:05.979889 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7ca6c17d-513d-41b4-8d8d-09e2defc9766 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:05.984673 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7ca6c17d-513d-41b4-8d8d-09e2defc9766 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:06.106544 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-7ca6c17d-513d-41b4-8d8d-09e2defc9766 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:06.113881 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-7ca6c17d-513d-41b4-8d8d-09e2defc9766 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 0.148890 Aug 27 01:31:06.114442 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 86/179] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:05 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:06.507001 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-488f4a9d-7640-4215-8224-46eb4ac242b6 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:06.511386 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-488f4a9d-7640-4215-8224-46eb4ac242b6 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:06.513787 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-488f4a9d-7640-4215-8224-46eb4ac242b6 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:06.514245 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-488f4a9d-7640-4215-8224-46eb4ac242b6 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:06.516293 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-488f4a9d-7640-4215-8224-46eb4ac242b6 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:06.516726 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-488f4a9d-7640-4215-8224-46eb4ac242b6 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:06.595139 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-fd8dbfdf-b8ff-40fb-94ee-d3cdefdde235 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:06.596039 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-fd8dbfdf-b8ff-40fb-94ee-d3cdefdde235 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:06.601811 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fd8dbfdf-b8ff-40fb-94ee-d3cdefdde235 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:06.602255 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fd8dbfdf-b8ff-40fb-94ee-d3cdefdde235 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:06.603016 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fd8dbfdf-b8ff-40fb-94ee-d3cdefdde235 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:06.603449 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fd8dbfdf-b8ff-40fb-94ee-d3cdefdde235 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:06.638049 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-488f4a9d-7640-4215-8224-46eb4ac242b6 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:06.649349 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-488f4a9d-7640-4215-8224-46eb4ac242b6 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.145872 Aug 27 01:31:06.657998 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 94/180] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:06 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:06.729066 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-fd8dbfdf-b8ff-40fb-94ee-d3cdefdde235 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:06.736716 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-fd8dbfdf-b8ff-40fb-94ee-d3cdefdde235 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1322 microversion: 2.1 time: 0.145472 Aug 27 01:31:06.737297 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 87/181] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:06 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:06.767684 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-0ebf0564-2f45-4879-b866-588a287978ca tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:06.768314 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-0ebf0564-2f45-4879-b866-588a287978ca tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:06.774106 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0ebf0564-2f45-4879-b866-588a287978ca tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:06.774548 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0ebf0564-2f45-4879-b866-588a287978ca tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:06.775382 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0ebf0564-2f45-4879-b866-588a287978ca tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:06.775807 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0ebf0564-2f45-4879-b866-588a287978ca tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:06.895034 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-0ebf0564-2f45-4879-b866-588a287978ca tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:06.902098 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-0ebf0564-2f45-4879-b866-588a287978ca tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1362 microversion: 2.1 time: 0.138620 Aug 27 01:31:06.902648 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 95/182] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:06 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1362 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:06.984822 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-07d24786-f6b9-4b8b-b741-66050ca7ac87 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:06.985386 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-07d24786-f6b9-4b8b-b741-66050ca7ac87 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:06.991252 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-07d24786-f6b9-4b8b-b741-66050ca7ac87 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:06.991695 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-07d24786-f6b9-4b8b-b741-66050ca7ac87 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:06.992453 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-07d24786-f6b9-4b8b-b741-66050ca7ac87 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:06.992914 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-07d24786-f6b9-4b8b-b741-66050ca7ac87 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:07.112281 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-07d24786-f6b9-4b8b-b741-66050ca7ac87 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:07.119866 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-07d24786-f6b9-4b8b-b741-66050ca7ac87 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:07.121399 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-07d24786-f6b9-4b8b-b741-66050ca7ac87 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:07.122467 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-07d24786-f6b9-4b8b-b741-66050ca7ac87 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1406 microversion: 2.20 time: 0.141877 Aug 27 01:31:07.123024 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 88/183] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:31:06 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1406 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:31:07.130613 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-5f9a8732-951d-4644-8c8c-10eb87a9ff94 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:07.131361 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-5f9a8732-951d-4644-8c8c-10eb87a9ff94 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:07.137350 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5f9a8732-951d-4644-8c8c-10eb87a9ff94 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:07.137794 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5f9a8732-951d-4644-8c8c-10eb87a9ff94 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:07.138544 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5f9a8732-951d-4644-8c8c-10eb87a9ff94 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:07.138970 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5f9a8732-951d-4644-8c8c-10eb87a9ff94 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:07.258037 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-5f9a8732-951d-4644-8c8c-10eb87a9ff94 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:07.265104 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-5f9a8732-951d-4644-8c8c-10eb87a9ff94 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 0.138094 Aug 27 01:31:07.265649 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 96/184] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:07 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:07.667831 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c4c790b6-5110-4d4e-88a5-dfea42b51a37 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:07.668472 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c4c790b6-5110-4d4e-88a5-dfea42b51a37 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:07.674871 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c4c790b6-5110-4d4e-88a5-dfea42b51a37 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:07.675311 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c4c790b6-5110-4d4e-88a5-dfea42b51a37 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:07.676069 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c4c790b6-5110-4d4e-88a5-dfea42b51a37 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:07.676528 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c4c790b6-5110-4d4e-88a5-dfea42b51a37 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:07.753283 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-fddf152a-460b-41cc-9c25-b425750caf8b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:07.754007 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-fddf152a-460b-41cc-9c25-b425750caf8b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:07.760151 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fddf152a-460b-41cc-9c25-b425750caf8b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:07.760591 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fddf152a-460b-41cc-9c25-b425750caf8b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:07.761376 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fddf152a-460b-41cc-9c25-b425750caf8b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:07.762107 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fddf152a-460b-41cc-9c25-b425750caf8b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:07.813930 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c4c790b6-5110-4d4e-88a5-dfea42b51a37 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:07.825253 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c4c790b6-5110-4d4e-88a5-dfea42b51a37 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.160648 Aug 27 01:31:07.826211 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 89/185] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:07 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:07.890318 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-fddf152a-460b-41cc-9c25-b425750caf8b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:07.899750 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-fddf152a-460b-41cc-9c25-b425750caf8b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1322 microversion: 2.1 time: 0.149740 Aug 27 01:31:07.900700 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 97/186] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:07 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:07.919607 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-56d691b1-ffa9-4c8e-a92e-6984e1cd5a24 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:07.926262 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-56d691b1-ffa9-4c8e-a92e-6984e1cd5a24 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:07.927030 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-56d691b1-ffa9-4c8e-a92e-6984e1cd5a24 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:07.927802 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-56d691b1-ffa9-4c8e-a92e-6984e1cd5a24 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:07.929217 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-56d691b1-ffa9-4c8e-a92e-6984e1cd5a24 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:07.929799 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-56d691b1-ffa9-4c8e-a92e-6984e1cd5a24 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:08.142701 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-dd186da2-dac9-430b-93bb-e99cd8ed0c36 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:08.143660 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-dd186da2-dac9-430b-93bb-e99cd8ed0c36 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:08.150226 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-dd186da2-dac9-430b-93bb-e99cd8ed0c36 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:08.151141 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-dd186da2-dac9-430b-93bb-e99cd8ed0c36 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:08.151450 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-dd186da2-dac9-430b-93bb-e99cd8ed0c36 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:08.151880 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-dd186da2-dac9-430b-93bb-e99cd8ed0c36 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:08.178211 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-56d691b1-ffa9-4c8e-a92e-6984e1cd5a24 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:08.189660 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-56d691b1-ffa9-4c8e-a92e-6984e1cd5a24 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1362 microversion: 2.1 time: 0.273807 Aug 27 01:31:08.190696 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 90/187] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:07 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:08.282088 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-e1fe4463-2d2b-48df-a122-c78e16b580ea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:08.282692 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-e1fe4463-2d2b-48df-a122-c78e16b580ea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:08.288730 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e1fe4463-2d2b-48df-a122-c78e16b580ea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:08.289272 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e1fe4463-2d2b-48df-a122-c78e16b580ea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:08.289951 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e1fe4463-2d2b-48df-a122-c78e16b580ea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:08.290377 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e1fe4463-2d2b-48df-a122-c78e16b580ea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:08.292227 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-dd186da2-dac9-430b-93bb-e99cd8ed0c36 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:08.300748 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-dd186da2-dac9-430b-93bb-e99cd8ed0c36 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:08.302294 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-dd186da2-dac9-430b-93bb-e99cd8ed0c36 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:08.303367 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-dd186da2-dac9-430b-93bb-e99cd8ed0c36 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1406 microversion: 2.20 time: 0.165963 Aug 27 01:31:08.303914 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 98/188] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:31:08 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:31:08.414675 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-e1fe4463-2d2b-48df-a122-c78e16b580ea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:08.422570 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-e1fe4463-2d2b-48df-a122-c78e16b580ea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 0.145005 Aug 27 01:31:08.423132 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 91/189] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:08 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:08.843669 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b9ee9ce8-27d8-45d5-ac82-13ebef0fa41d tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:08.844220 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b9ee9ce8-27d8-45d5-ac82-13ebef0fa41d tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:08.850133 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b9ee9ce8-27d8-45d5-ac82-13ebef0fa41d tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:08.850682 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b9ee9ce8-27d8-45d5-ac82-13ebef0fa41d tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:08.851579 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b9ee9ce8-27d8-45d5-ac82-13ebef0fa41d tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:08.852033 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b9ee9ce8-27d8-45d5-ac82-13ebef0fa41d tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:08.919426 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-80306a73-c34b-4806-a1b7-506c20cccdab tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:08.920036 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-80306a73-c34b-4806-a1b7-506c20cccdab tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:08.926306 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-80306a73-c34b-4806-a1b7-506c20cccdab tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:08.926753 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-80306a73-c34b-4806-a1b7-506c20cccdab tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:08.927529 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-80306a73-c34b-4806-a1b7-506c20cccdab tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:08.927963 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-80306a73-c34b-4806-a1b7-506c20cccdab tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:09.057389 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-80306a73-c34b-4806-a1b7-506c20cccdab tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:09.070074 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-80306a73-c34b-4806-a1b7-506c20cccdab tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1322 microversion: 2.1 time: 0.154279 Aug 27 01:31:09.070653 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 92/190] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:08 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:09.160104 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-b9ee9ce8-27d8-45d5-ac82-13ebef0fa41d tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:09.167204 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b9ee9ce8-27d8-45d5-ac82-13ebef0fa41d tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.327578 Aug 27 01:31:09.167750 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 99/191] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:08 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:09.208880 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-95709019-aeb6-427f-845f-e1289a39af22 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:09.209617 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-95709019-aeb6-427f-845f-e1289a39af22 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:09.215526 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-95709019-aeb6-427f-845f-e1289a39af22 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:09.216032 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-95709019-aeb6-427f-845f-e1289a39af22 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:09.218360 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-95709019-aeb6-427f-845f-e1289a39af22 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:09.218360 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-95709019-aeb6-427f-845f-e1289a39af22 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:09.322416 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-8e16b319-e872-4973-bac0-36cb628edec8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:09.323023 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-8e16b319-e872-4973-bac0-36cb628edec8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:09.330168 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8e16b319-e872-4973-bac0-36cb628edec8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:09.330612 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8e16b319-e872-4973-bac0-36cb628edec8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:09.331411 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8e16b319-e872-4973-bac0-36cb628edec8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:09.331836 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8e16b319-e872-4973-bac0-36cb628edec8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:09.343316 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-95709019-aeb6-427f-845f-e1289a39af22 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:09.351378 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-95709019-aeb6-427f-845f-e1289a39af22 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1362 microversion: 2.1 time: 0.146489 Aug 27 01:31:09.351939 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 93/192] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:09 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:09.439793 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-05344ad9-6409-4ece-a3ae-73e2f27242db tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:09.440389 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-05344ad9-6409-4ece-a3ae-73e2f27242db tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:09.446122 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-05344ad9-6409-4ece-a3ae-73e2f27242db tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:09.446554 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-05344ad9-6409-4ece-a3ae-73e2f27242db tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:09.447304 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-05344ad9-6409-4ece-a3ae-73e2f27242db tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:09.447726 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-05344ad9-6409-4ece-a3ae-73e2f27242db tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:09.454389 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-8e16b319-e872-4973-bac0-36cb628edec8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:09.461961 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-8e16b319-e872-4973-bac0-36cb628edec8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:09.463446 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-8e16b319-e872-4973-bac0-36cb628edec8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:09.464568 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-8e16b319-e872-4973-bac0-36cb628edec8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1406 microversion: 2.20 time: 0.146376 Aug 27 01:31:09.465202 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 100/193] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:31:09 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1406 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:31:09.570549 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-05344ad9-6409-4ece-a3ae-73e2f27242db tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:09.577807 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-05344ad9-6409-4ece-a3ae-73e2f27242db tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 0.142354 Aug 27 01:31:09.578362 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 94/194] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:09 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:10.087176 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4d4095de-27ff-495d-8393-fbd08624c799 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:10.089282 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4d4095de-27ff-495d-8393-fbd08624c799 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:10.095378 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4d4095de-27ff-495d-8393-fbd08624c799 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:10.095822 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4d4095de-27ff-495d-8393-fbd08624c799 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:10.096595 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4d4095de-27ff-495d-8393-fbd08624c799 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:10.097068 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4d4095de-27ff-495d-8393-fbd08624c799 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:10.184054 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-b877ae1f-8e8a-4767-a462-ea7353c89559 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:10.185154 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-b877ae1f-8e8a-4767-a462-ea7353c89559 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:10.192720 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b877ae1f-8e8a-4767-a462-ea7353c89559 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:10.193231 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b877ae1f-8e8a-4767-a462-ea7353c89559 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:10.194251 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b877ae1f-8e8a-4767-a462-ea7353c89559 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:10.194842 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b877ae1f-8e8a-4767-a462-ea7353c89559 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:10.227298 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4d4095de-27ff-495d-8393-fbd08624c799 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:10.235342 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4d4095de-27ff-495d-8393-fbd08624c799 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1322 microversion: 2.1 time: 0.151596 Aug 27 01:31:10.235851 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 101/195] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:10 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:10.248014 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-f423296f-2e4f-4bdb-986f-1d2a6ed690ef req-ad9730bb-ff2a-4586-8140-4b6371c51cbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a469663-cc2c-4a11-8486-a758a0682e39", "name": "network-vif-plugged", "status": "completed", "tag": "f0fa47c1-eb17-4a46-982a-113bf408fe87"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:10.250451 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:31:10.250451 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:31:10.257307 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-f423296f-2e4f-4bdb-986f-1d2a6ed690ef req-ad9730bb-ff2a-4586-8140-4b6371c51cbe service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:10.257743 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-f423296f-2e4f-4bdb-986f-1d2a6ed690ef req-ad9730bb-ff2a-4586-8140-4b6371c51cbe service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:10.268562 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-f423296f-2e4f-4bdb-986f-1d2a6ed690ef req-ad9730bb-ff2a-4586-8140-4b6371c51cbe service nova] Creating event network-vif-plugged:f0fa47c1-eb17-4a46-982a-113bf408fe87 for instance 5a469663-cc2c-4a11-8486-a758a0682e39 on hv-cinder-75916 Aug 27 01:31:10.273491 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-f423296f-2e4f-4bdb-986f-1d2a6ed690ef req-ad9730bb-ff2a-4586-8140-4b6371c51cbe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028937 Aug 27 01:31:10.274253 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 102/196] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:31:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:31:10.327583 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-b877ae1f-8e8a-4767-a462-ea7353c89559 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:10.336128 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-b877ae1f-8e8a-4767-a462-ea7353c89559 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.155162 Aug 27 01:31:10.336966 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 95/197] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:10 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:10.370491 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-8441ddcc-cdaf-46aa-b28d-87a7f28ad489 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:10.371505 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-8441ddcc-cdaf-46aa-b28d-87a7f28ad489 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:10.377668 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8441ddcc-cdaf-46aa-b28d-87a7f28ad489 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:10.378110 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8441ddcc-cdaf-46aa-b28d-87a7f28ad489 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:10.379031 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8441ddcc-cdaf-46aa-b28d-87a7f28ad489 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:10.379479 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8441ddcc-cdaf-46aa-b28d-87a7f28ad489 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:10.486122 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-2511d3b7-f0f1-4a34-9315-67020375d69b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:10.487027 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-2511d3b7-f0f1-4a34-9315-67020375d69b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:10.493536 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2511d3b7-f0f1-4a34-9315-67020375d69b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:10.494177 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2511d3b7-f0f1-4a34-9315-67020375d69b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:10.495168 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2511d3b7-f0f1-4a34-9315-67020375d69b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:10.495753 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2511d3b7-f0f1-4a34-9315-67020375d69b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:10.525312 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-8441ddcc-cdaf-46aa-b28d-87a7f28ad489 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:10.532825 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-8441ddcc-cdaf-46aa-b28d-87a7f28ad489 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1548 microversion: 2.1 time: 0.167238 Aug 27 01:31:10.533413 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 103/198] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:10 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1548 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:10.553751 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-efde6f0e-b31c-4ad1-b8f4-2021a6030e89 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:10.554243 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-efde6f0e-b31c-4ad1-b8f4-2021a6030e89 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:10.566298 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-efde6f0e-b31c-4ad1-b8f4-2021a6030e89 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:10.566894 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-efde6f0e-b31c-4ad1-b8f4-2021a6030e89 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:10.568006 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-efde6f0e-b31c-4ad1-b8f4-2021a6030e89 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:10.568613 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-efde6f0e-b31c-4ad1-b8f4-2021a6030e89 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:10.626825 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-2511d3b7-f0f1-4a34-9315-67020375d69b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:10.642429 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-2511d3b7-f0f1-4a34-9315-67020375d69b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:10.643923 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-2511d3b7-f0f1-4a34-9315-67020375d69b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:10.645029 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-2511d3b7-f0f1-4a34-9315-67020375d69b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1406 microversion: 2.20 time: 0.166291 Aug 27 01:31:10.645571 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 96/199] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:31:10 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:31:10.650232 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-389c830c-6369-44d6-bdfb-c83bd4d36166 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:10.651022 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-389c830c-6369-44d6-bdfb-c83bd4d36166 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:10.657666 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-389c830c-6369-44d6-bdfb-c83bd4d36166 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:10.658104 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-389c830c-6369-44d6-bdfb-c83bd4d36166 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:10.659194 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-389c830c-6369-44d6-bdfb-c83bd4d36166 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:10.659473 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-389c830c-6369-44d6-bdfb-c83bd4d36166 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:10.697280 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-efde6f0e-b31c-4ad1-b8f4-2021a6030e89 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.147070 Aug 27 01:31:10.701298 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 104/200] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Aug 27 01:31:10 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:31:10.795727 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-389c830c-6369-44d6-bdfb-c83bd4d36166 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:10.829950 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-389c830c-6369-44d6-bdfb-c83bd4d36166 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1318 microversion: 2.1 time: 0.183096 Aug 27 01:31:10.836085 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 97/201] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:10 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:11.253533 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-6fc8f291-1708-426e-ace4-4cf4f6d48762 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:11.254139 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-6fc8f291-1708-426e-ace4-4cf4f6d48762 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:11.260269 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6fc8f291-1708-426e-ace4-4cf4f6d48762 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:11.260711 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6fc8f291-1708-426e-ace4-4cf4f6d48762 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:11.261528 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6fc8f291-1708-426e-ace4-4cf4f6d48762 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:11.261959 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6fc8f291-1708-426e-ace4-4cf4f6d48762 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:11.354701 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-7b4c265a-ea99-43a9-928a-05b1af9dba85 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:11.355225 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-7b4c265a-ea99-43a9-928a-05b1af9dba85 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:11.361501 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7b4c265a-ea99-43a9-928a-05b1af9dba85 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:11.361944 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7b4c265a-ea99-43a9-928a-05b1af9dba85 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:11.362735 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7b4c265a-ea99-43a9-928a-05b1af9dba85 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:11.363169 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7b4c265a-ea99-43a9-928a-05b1af9dba85 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:11.485798 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-7b4c265a-ea99-43a9-928a-05b1af9dba85 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:11.493253 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-7b4c265a-ea99-43a9-928a-05b1af9dba85 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.142321 Aug 27 01:31:11.493933 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 98/202] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:11 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:11.527175 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-6fc8f291-1708-426e-ace4-4cf4f6d48762 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:11.535014 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-6fc8f291-1708-426e-ace4-4cf4f6d48762 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1322 microversion: 2.1 time: 0.285573 Aug 27 01:31:11.535566 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 105/203] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:11 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:11.661756 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-81e8efa3-8c6d-4b33-b13c-c59726a95f19 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:11.662349 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-81e8efa3-8c6d-4b33-b13c-c59726a95f19 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:11.668144 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-81e8efa3-8c6d-4b33-b13c-c59726a95f19 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:11.668577 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-81e8efa3-8c6d-4b33-b13c-c59726a95f19 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:11.669373 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-81e8efa3-8c6d-4b33-b13c-c59726a95f19 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:11.669796 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-81e8efa3-8c6d-4b33-b13c-c59726a95f19 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:11.795279 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-81e8efa3-8c6d-4b33-b13c-c59726a95f19 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:11.804790 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-81e8efa3-8c6d-4b33-b13c-c59726a95f19 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:11.807128 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-81e8efa3-8c6d-4b33-b13c-c59726a95f19 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:11.808244 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-81e8efa3-8c6d-4b33-b13c-c59726a95f19 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1406 microversion: 2.20 time: 0.150192 Aug 27 01:31:11.808811 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 99/204] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:31:11 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:31:11.849739 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-c077fd5c-612e-4995-b85c-941e6bf6a1f8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:11.850933 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-c077fd5c-612e-4995-b85c-941e6bf6a1f8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:11.857934 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c077fd5c-612e-4995-b85c-941e6bf6a1f8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:11.858507 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c077fd5c-612e-4995-b85c-941e6bf6a1f8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:11.863907 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c077fd5c-612e-4995-b85c-941e6bf6a1f8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:11.864371 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c077fd5c-612e-4995-b85c-941e6bf6a1f8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:12.126377 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-c077fd5c-612e-4995-b85c-941e6bf6a1f8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:12.134004 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-c077fd5c-612e-4995-b85c-941e6bf6a1f8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1508 microversion: 2.1 time: 0.289547 Aug 27 01:31:12.145130 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 106/205] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:11 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1508 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:12.291545 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-e2349a92-e31a-43eb-9778-c62643f9c126 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:12.292734 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-e2349a92-e31a-43eb-9778-c62643f9c126 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:12.293736 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-0a7b3bf8-5869-4db1-a6de-7dadb3dc94d2 req-c99e7eb4-651f-4028-aef9-11e7f5843334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be807b17-abdc-4d79-b58d-b42998cdb479", "tag": "f18d8c2b-ab08-4402-a440-92bdcf75c38a"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:12.295338 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:31:12.295338 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:31:12.299090 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e2349a92-e31a-43eb-9778-c62643f9c126 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:12.299586 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e2349a92-e31a-43eb-9778-c62643f9c126 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:12.300361 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e2349a92-e31a-43eb-9778-c62643f9c126 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:12.300792 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e2349a92-e31a-43eb-9778-c62643f9c126 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:12.303812 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-0a7b3bf8-5869-4db1-a6de-7dadb3dc94d2 req-c99e7eb4-651f-4028-aef9-11e7f5843334 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:12.304432 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-0a7b3bf8-5869-4db1-a6de-7dadb3dc94d2 req-c99e7eb4-651f-4028-aef9-11e7f5843334 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:12.318033 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-0a7b3bf8-5869-4db1-a6de-7dadb3dc94d2 req-c99e7eb4-651f-4028-aef9-11e7f5843334 service nova] Creating event network-changed:f18d8c2b-ab08-4402-a440-92bdcf75c38a for instance be807b17-abdc-4d79-b58d-b42998cdb479 on hv-cinder-75916 Aug 27 01:31:12.323705 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-0a7b3bf8-5869-4db1-a6de-7dadb3dc94d2 req-c99e7eb4-651f-4028-aef9-11e7f5843334 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033526 Aug 27 01:31:12.324281 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 107/206] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:31:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:31:12.510043 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-e895da25-1ac6-4296-9082-e5ffd386c754 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:12.510720 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-e895da25-1ac6-4296-9082-e5ffd386c754 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:12.517195 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e895da25-1ac6-4296-9082-e5ffd386c754 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:12.517634 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e895da25-1ac6-4296-9082-e5ffd386c754 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:12.518385 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e895da25-1ac6-4296-9082-e5ffd386c754 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:12.518807 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e895da25-1ac6-4296-9082-e5ffd386c754 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:12.641538 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-e895da25-1ac6-4296-9082-e5ffd386c754 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:12.649430 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-e895da25-1ac6-4296-9082-e5ffd386c754 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.142861 Aug 27 01:31:12.650518 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 108/207] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:12 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:12.656234 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-87d0faf6-eefa-4b70-b10a-97ec450eda26 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:12.656851 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-87d0faf6-eefa-4b70-b10a-97ec450eda26 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:12.669440 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-87d0faf6-eefa-4b70-b10a-97ec450eda26 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:12.669440 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-87d0faf6-eefa-4b70-b10a-97ec450eda26 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:12.669440 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-87d0faf6-eefa-4b70-b10a-97ec450eda26 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:12.669440 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-87d0faf6-eefa-4b70-b10a-97ec450eda26 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:12.818316 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-87d0faf6-eefa-4b70-b10a-97ec450eda26 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:12.826028 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-87d0faf6-eefa-4b70-b10a-97ec450eda26 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1322 microversion: 2.1 time: 0.173981 Aug 27 01:31:12.827111 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 109/208] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:12 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:12.831523 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-0d88b3f5-0ff6-4421-9bfc-8df9b3ee04f6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:12.832115 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-0d88b3f5-0ff6-4421-9bfc-8df9b3ee04f6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:12.838025 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0d88b3f5-0ff6-4421-9bfc-8df9b3ee04f6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:12.838462 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0d88b3f5-0ff6-4421-9bfc-8df9b3ee04f6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:12.839294 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0d88b3f5-0ff6-4421-9bfc-8df9b3ee04f6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:12.839710 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0d88b3f5-0ff6-4421-9bfc-8df9b3ee04f6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:12.969047 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-0d88b3f5-0ff6-4421-9bfc-8df9b3ee04f6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:12.977838 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-0d88b3f5-0ff6-4421-9bfc-8df9b3ee04f6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:12.979335 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-0d88b3f5-0ff6-4421-9bfc-8df9b3ee04f6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:12.980522 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-0d88b3f5-0ff6-4421-9bfc-8df9b3ee04f6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1598 microversion: 2.20 time: 0.152358 Aug 27 01:31:12.981112 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 110/209] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:31:12 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:31:12.999735 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-0f028cf0-5b46-443e-9bac-41e52d4070b3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:13.000320 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-0f028cf0-5b46-443e-9bac-41e52d4070b3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:13.006886 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0f028cf0-5b46-443e-9bac-41e52d4070b3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:13.007319 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0f028cf0-5b46-443e-9bac-41e52d4070b3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:13.008088 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0f028cf0-5b46-443e-9bac-41e52d4070b3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:13.008511 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0f028cf0-5b46-443e-9bac-41e52d4070b3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:13.088744 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-0f028cf0-5b46-443e-9bac-41e52d4070b3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092905 Aug 27 01:31:13.089413 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 111/210] 10.222.0.25 () {60 vars in 1316 bytes} [Fri Aug 27 01:31:12 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:31:13.666334 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-6a8a0694-65f3-4842-9f94-fda8462b004f tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:13.667012 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-6a8a0694-65f3-4842-9f94-fda8462b004f tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:13.678272 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6a8a0694-65f3-4842-9f94-fda8462b004f tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:13.678272 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6a8a0694-65f3-4842-9f94-fda8462b004f tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:13.678272 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6a8a0694-65f3-4842-9f94-fda8462b004f tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:13.678272 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6a8a0694-65f3-4842-9f94-fda8462b004f tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:13.912053 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-6a8a0694-65f3-4842-9f94-fda8462b004f tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:13.919688 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-6a8a0694-65f3-4842-9f94-fda8462b004f tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.257552 Aug 27 01:31:13.922010 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 112/211] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:13 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:13.926111 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-5727d629-e6eb-4c0d-90fb-f1493f1d0f6e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:13.926866 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-5727d629-e6eb-4c0d-90fb-f1493f1d0f6e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:13.933021 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5727d629-e6eb-4c0d-90fb-f1493f1d0f6e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:13.933507 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5727d629-e6eb-4c0d-90fb-f1493f1d0f6e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:13.934297 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5727d629-e6eb-4c0d-90fb-f1493f1d0f6e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:13.934719 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5727d629-e6eb-4c0d-90fb-f1493f1d0f6e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:14.114779 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-5727d629-e6eb-4c0d-90fb-f1493f1d0f6e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:14.121933 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-5727d629-e6eb-4c0d-90fb-f1493f1d0f6e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1322 microversion: 2.1 time: 0.199763 Aug 27 01:31:14.122501 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 113/212] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:13 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:14.258506 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-e209d5eb-17f9-4245-a086-7f5395d05046 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:14.259481 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-e209d5eb-17f9-4245-a086-7f5395d05046 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:14.266394 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e209d5eb-17f9-4245-a086-7f5395d05046 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:14.266938 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e209d5eb-17f9-4245-a086-7f5395d05046 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:14.267798 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e209d5eb-17f9-4245-a086-7f5395d05046 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:14.268425 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e209d5eb-17f9-4245-a086-7f5395d05046 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:16.658455 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-e2349a92-e31a-43eb-9778-c62643f9c126 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 14 microversion: 2.1 time: 4.370906 Aug 27 01:31:16.659063 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 100/213] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:31:12 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 14 bytes in 4373 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 01:31:16.663984 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-144a1eb7-9e6f-43ca-8453-75976ff47a91 req-4766384e-7bba-4370-a09e-a67a662b0453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ec83298-8a1e-4edd-be07-4e0592a0ce04", "tag": "5f7cab4d-54ba-4757-bb8d-1d2f0a14a90e"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:16.665580 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:31:16.665580 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:31:16.674651 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-144a1eb7-9e6f-43ca-8453-75976ff47a91 req-4766384e-7bba-4370-a09e-a67a662b0453 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:16.675032 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-144a1eb7-9e6f-43ca-8453-75976ff47a91 req-4766384e-7bba-4370-a09e-a67a662b0453 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:16.685128 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-144a1eb7-9e6f-43ca-8453-75976ff47a91 req-4766384e-7bba-4370-a09e-a67a662b0453 service nova] Creating event network-changed:5f7cab4d-54ba-4757-bb8d-1d2f0a14a90e for instance 6ec83298-8a1e-4edd-be07-4e0592a0ce04 on hv-cinder-75916 Aug 27 01:31:16.690467 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-144a1eb7-9e6f-43ca-8453-75976ff47a91 req-4766384e-7bba-4370-a09e-a67a662b0453 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030155 Aug 27 01:31:16.692025 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 101/214] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:31:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:31:16.695697 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-e4378399-4495-40a1-8d0f-e9cc681623f6 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:16.696545 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-e4378399-4495-40a1-8d0f-e9cc681623f6 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:16.703067 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e4378399-4495-40a1-8d0f-e9cc681623f6 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:16.703508 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e4378399-4495-40a1-8d0f-e9cc681623f6 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:16.704261 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e4378399-4495-40a1-8d0f-e9cc681623f6 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:16.704687 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e4378399-4495-40a1-8d0f-e9cc681623f6 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:16.708525 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-e209d5eb-17f9-4245-a086-7f5395d05046 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 14 microversion: 2.20 time: 2.453483 Aug 27 01:31:16.714114 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 114/215] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:31:14 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 14 bytes in 2455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:16.714114 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-e0f93b03-1d11-4c8d-ac5d-38fa2882bc3c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:16.714790 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-e0f93b03-1d11-4c8d-ac5d-38fa2882bc3c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:16.722796 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e0f93b03-1d11-4c8d-ac5d-38fa2882bc3c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:16.723452 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e0f93b03-1d11-4c8d-ac5d-38fa2882bc3c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:16.724216 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e0f93b03-1d11-4c8d-ac5d-38fa2882bc3c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:16.724640 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e0f93b03-1d11-4c8d-ac5d-38fa2882bc3c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:16.840515 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-e4378399-4495-40a1-8d0f-e9cc681623f6 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:16.849206 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-e4378399-4495-40a1-8d0f-e9cc681623f6 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1314 microversion: 2.1 time: 0.156980 Aug 27 01:31:16.858251 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 102/216] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:16 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:16.900054 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-e0f93b03-1d11-4c8d-ac5d-38fa2882bc3c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:16.908099 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-e0f93b03-1d11-4c8d-ac5d-38fa2882bc3c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1322 microversion: 2.1 time: 0.197766 Aug 27 01:31:16.908882 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 115/217] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:16 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:17.670641 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-45068a08-bc92-4b7e-a162-ad3c7ab315dc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:17.671578 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-45068a08-bc92-4b7e-a162-ad3c7ab315dc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:17.677770 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-45068a08-bc92-4b7e-a162-ad3c7ab315dc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:17.678287 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-45068a08-bc92-4b7e-a162-ad3c7ab315dc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:17.679063 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-45068a08-bc92-4b7e-a162-ad3c7ab315dc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:17.679495 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-45068a08-bc92-4b7e-a162-ad3c7ab315dc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:17.723168 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-12d76174-6e14-4dff-b98c-9035c42e1fb9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:17.724873 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-12d76174-6e14-4dff-b98c-9035c42e1fb9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:17.731204 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-12d76174-6e14-4dff-b98c-9035c42e1fb9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:17.731687 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-12d76174-6e14-4dff-b98c-9035c42e1fb9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:17.732454 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-12d76174-6e14-4dff-b98c-9035c42e1fb9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:17.733688 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-12d76174-6e14-4dff-b98c-9035c42e1fb9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:17.866289 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-45068a08-bc92-4b7e-a162-ad3c7ab315dc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 14 microversion: 2.1 time: 0.199861 Aug 27 01:31:17.867006 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 103/218] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:31:17 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 14 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 01:31:17.874633 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-b6f1da65-8b50-4ef0-8a58-1a8b6d95a32e tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:17.875453 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-b6f1da65-8b50-4ef0-8a58-1a8b6d95a32e tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:17.881951 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b6f1da65-8b50-4ef0-8a58-1a8b6d95a32e tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:17.882398 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b6f1da65-8b50-4ef0-8a58-1a8b6d95a32e tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:17.883195 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b6f1da65-8b50-4ef0-8a58-1a8b6d95a32e tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:17.883624 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b6f1da65-8b50-4ef0-8a58-1a8b6d95a32e tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:17.908320 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-12d76174-6e14-4dff-b98c-9035c42e1fb9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 14 microversion: 2.20 time: 0.189190 Aug 27 01:31:17.911663 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 116/219] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:31:17 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 14 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:17.925835 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-09eace78-fbd3-4a1b-984f-849020b617b6 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:17.926529 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-09eace78-fbd3-4a1b-984f-849020b617b6 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:17.936017 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-09eace78-fbd3-4a1b-984f-849020b617b6 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:17.936017 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-09eace78-fbd3-4a1b-984f-849020b617b6 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:17.936017 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-09eace78-fbd3-4a1b-984f-849020b617b6 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:17.936017 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-09eace78-fbd3-4a1b-984f-849020b617b6 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:18.027258 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-b6f1da65-8b50-4ef0-8a58-1a8b6d95a32e tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:18.037708 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-b6f1da65-8b50-4ef0-8a58-1a8b6d95a32e tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1501 microversion: 2.1 time: 0.166650 Aug 27 01:31:18.049550 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 104/220] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:17 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1501 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:18.057585 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-91729b90-892e-4157-bc82-77899172359d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aefa404e-db71-404c-b703-fb601d61ae51"}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:18.058823 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-91729b90-892e-4157-bc82-77899172359d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:18.066333 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-91729b90-892e-4157-bc82-77899172359d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:18.067835 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-91729b90-892e-4157-bc82-77899172359d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:18.069496 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-91729b90-892e-4157-bc82-77899172359d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:18.069971 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-91729b90-892e-4157-bc82-77899172359d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:18.191674 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-09eace78-fbd3-4a1b-984f-849020b617b6 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:18.201065 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-09eace78-fbd3-4a1b-984f-849020b617b6 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1322 microversion: 2.1 time: 0.279273 Aug 27 01:31:18.206203 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 117/221] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:17 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:18.877331 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-3b165dba-5068-40e5-9e53-0abdc6180681 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:18.878239 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-3b165dba-5068-40e5-9e53-0abdc6180681 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:18.890291 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3b165dba-5068-40e5-9e53-0abdc6180681 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:18.890733 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3b165dba-5068-40e5-9e53-0abdc6180681 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:18.891515 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3b165dba-5068-40e5-9e53-0abdc6180681 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:18.891941 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3b165dba-5068-40e5-9e53-0abdc6180681 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:18.898798 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-91729b90-892e-4157-bc82-77899172359d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "POST /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.846994 Aug 27 01:31:18.899400 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 105/222] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Aug 27 01:31:18 2021] POST /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66/os-volume_attachments => generated 194 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:31:18.928714 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-faa178f3-5f0e-4564-849f-e05f391fbc2f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:18.929125 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-faa178f3-5f0e-4564-849f-e05f391fbc2f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:18.939479 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-faa178f3-5f0e-4564-849f-e05f391fbc2f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:18.940213 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-faa178f3-5f0e-4564-849f-e05f391fbc2f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:18.941560 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-faa178f3-5f0e-4564-849f-e05f391fbc2f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:18.942281 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-faa178f3-5f0e-4564-849f-e05f391fbc2f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:19.097656 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-3b165dba-5068-40e5-9e53-0abdc6180681 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 14 microversion: 2.1 time: 0.224147 Aug 27 01:31:19.099496 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 118/223] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:31:18 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 14 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 01:31:19.182462 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-faa178f3-5f0e-4564-849f-e05f391fbc2f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 14 microversion: 2.20 time: 0.261703 Aug 27 01:31:19.186376 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 106/224] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:31:18 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 14 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:19.220011 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-c864bc63-47dd-4346-8e4f-f04ba1b3eceb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:19.220889 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-c864bc63-47dd-4346-8e4f-f04ba1b3eceb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:19.233866 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c864bc63-47dd-4346-8e4f-f04ba1b3eceb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:19.233866 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c864bc63-47dd-4346-8e4f-f04ba1b3eceb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:19.233866 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c864bc63-47dd-4346-8e4f-f04ba1b3eceb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:19.233866 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c864bc63-47dd-4346-8e4f-f04ba1b3eceb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:19.360720 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-c864bc63-47dd-4346-8e4f-f04ba1b3eceb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:19.369777 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-c864bc63-47dd-4346-8e4f-f04ba1b3eceb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1516 microversion: 2.1 time: 0.155998 Aug 27 01:31:19.370432 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 119/225] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:19 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:19.391860 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-356f38ee-ba31-4930-bee1-a97c0abad03c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:19.392822 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-356f38ee-ba31-4930-bee1-a97c0abad03c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:19.400973 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-356f38ee-ba31-4930-bee1-a97c0abad03c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:19.401420 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-356f38ee-ba31-4930-bee1-a97c0abad03c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:19.402339 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-356f38ee-ba31-4930-bee1-a97c0abad03c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:19.402958 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-356f38ee-ba31-4930-bee1-a97c0abad03c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:19.429406 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.objects.instance [None req-356f38ee-ba31-4930-bee1-a97c0abad03c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lazy-loading 'flavor' on Instance uuid 5a469663-cc2c-4a11-8486-a758a0682e39 {{(pid=108756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:31:19.705335 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-356f38ee-ba31-4930-bee1-a97c0abad03c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "POST /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39/action" status: 200 len: 32 microversion: 2.1 time: 0.318304 Aug 27 01:31:19.710345 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 107/226] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:31:19 2021] POST /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39/action => generated 32 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 01:31:19.715284 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-bf0f253e-e93e-4594-a34b-dd9c2bf617bf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:19.715892 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-bf0f253e-e93e-4594-a34b-dd9c2bf617bf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:19.729706 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bf0f253e-e93e-4594-a34b-dd9c2bf617bf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:19.730698 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bf0f253e-e93e-4594-a34b-dd9c2bf617bf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:19.730904 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bf0f253e-e93e-4594-a34b-dd9c2bf617bf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:19.731331 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bf0f253e-e93e-4594-a34b-dd9c2bf617bf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:19.869761 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-0f135a12-6c56-4faa-8c15-6dacd919e6d6 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5e3d4f5-ce45-4167-8953-de11a5cf2d6f"}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:19.871241 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-0f135a12-6c56-4faa-8c15-6dacd919e6d6 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:19.878468 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0f135a12-6c56-4faa-8c15-6dacd919e6d6 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:19.879803 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0f135a12-6c56-4faa-8c15-6dacd919e6d6 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:19.881103 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0f135a12-6c56-4faa-8c15-6dacd919e6d6 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:19.882025 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0f135a12-6c56-4faa-8c15-6dacd919e6d6 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:19.916645 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-bf0f253e-e93e-4594-a34b-dd9c2bf617bf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:19.925612 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-bf0f253e-e93e-4594-a34b-dd9c2bf617bf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.214001 Aug 27 01:31:19.926383 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 120/227] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:19 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:20.109063 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-500fee7a-990e-4608-81dc-c72bf2293e9f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:20.110052 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-500fee7a-990e-4608-81dc-c72bf2293e9f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:20.115775 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-500fee7a-990e-4608-81dc-c72bf2293e9f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:20.116211 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-500fee7a-990e-4608-81dc-c72bf2293e9f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:20.116991 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-500fee7a-990e-4608-81dc-c72bf2293e9f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:20.117415 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-500fee7a-990e-4608-81dc-c72bf2293e9f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:24.036656 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-500fee7a-990e-4608-81dc-c72bf2293e9f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 14 microversion: 2.1 time: 3.931687 Aug 27 01:31:24.037338 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 121/228] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:31:20 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 14 bytes in 3933 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 01:31:24.042332 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-99b40f03-5dce-4965-b112-58153656d74d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:24.043394 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-99b40f03-5dce-4965-b112-58153656d74d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:24.054489 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-99b40f03-5dce-4965-b112-58153656d74d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:24.054935 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-99b40f03-5dce-4965-b112-58153656d74d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:24.055984 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-99b40f03-5dce-4965-b112-58153656d74d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:24.056409 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-99b40f03-5dce-4965-b112-58153656d74d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:24.204789 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-99b40f03-5dce-4965-b112-58153656d74d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 14 microversion: 2.20 time: 0.166027 Aug 27 01:31:24.205482 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 122/229] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:31:24 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:24.210866 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-91679182-ce6e-411c-ac9f-888798463aef tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:24.211628 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-91679182-ce6e-411c-ac9f-888798463aef tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:24.220314 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-91679182-ce6e-411c-ac9f-888798463aef tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:24.221006 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-91679182-ce6e-411c-ac9f-888798463aef tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:24.223571 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-91679182-ce6e-411c-ac9f-888798463aef tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:24.223571 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-91679182-ce6e-411c-ac9f-888798463aef tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:24.605777 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-91679182-ce6e-411c-ac9f-888798463aef tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:24.613594 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-91679182-ce6e-411c-ac9f-888798463aef tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.407037 Aug 27 01:31:24.614158 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 123/230] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:24 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:24.635382 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-0f135a12-6c56-4faa-8c15-6dacd919e6d6 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "POST /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.772064 Aug 27 01:31:24.640723 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 108/231] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Aug 27 01:31:19 2021] POST /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974/os-volume_attachments => generated 194 bytes in 4774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:31:25.047899 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-a036b759-f0da-4c97-b7c5-76783b3e7795 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:25.048775 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-a036b759-f0da-4c97-b7c5-76783b3e7795 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:25.054929 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a036b759-f0da-4c97-b7c5-76783b3e7795 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:25.055635 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a036b759-f0da-4c97-b7c5-76783b3e7795 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:25.056396 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a036b759-f0da-4c97-b7c5-76783b3e7795 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:25.056847 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a036b759-f0da-4c97-b7c5-76783b3e7795 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:25.216572 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-fc160f82-28b2-44c2-bd30-aff76ce3dda5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:25.217576 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-fc160f82-28b2-44c2-bd30-aff76ce3dda5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:25.223522 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fc160f82-28b2-44c2-bd30-aff76ce3dda5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:25.223956 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fc160f82-28b2-44c2-bd30-aff76ce3dda5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:25.224741 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fc160f82-28b2-44c2-bd30-aff76ce3dda5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:25.225191 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fc160f82-28b2-44c2-bd30-aff76ce3dda5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:28.138342 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-a036b759-f0da-4c97-b7c5-76783b3e7795 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 14 microversion: 2.1 time: 3.094116 Aug 27 01:31:28.139528 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 124/232] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:31:25 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 14 bytes in 3096 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 01:31:28.144861 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-0a5137ca-a29c-4a76-8765-ac76916dcba3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:28.145550 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-0a5137ca-a29c-4a76-8765-ac76916dcba3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:28.152798 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0a5137ca-a29c-4a76-8765-ac76916dcba3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:28.153290 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0a5137ca-a29c-4a76-8765-ac76916dcba3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:28.154056 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0a5137ca-a29c-4a76-8765-ac76916dcba3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:28.154482 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0a5137ca-a29c-4a76-8765-ac76916dcba3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:28.165035 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-fc160f82-28b2-44c2-bd30-aff76ce3dda5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 14 microversion: 2.20 time: 2.952252 Aug 27 01:31:28.165426 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 109/233] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:31:25 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 14 bytes in 2954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:28.279975 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-0a5137ca-a29c-4a76-8765-ac76916dcba3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:28.287999 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-0a5137ca-a29c-4a76-8765-ac76916dcba3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.147143 Aug 27 01:31:28.288563 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 125/234] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:28 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:29.150195 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-57822a04-2356-4d71-9cda-d2b1b1ac1107 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:29.151193 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-57822a04-2356-4d71-9cda-d2b1b1ac1107 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:29.158126 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-57822a04-2356-4d71-9cda-d2b1b1ac1107 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:29.158573 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-57822a04-2356-4d71-9cda-d2b1b1ac1107 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:29.159335 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-57822a04-2356-4d71-9cda-d2b1b1ac1107 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:29.159767 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-57822a04-2356-4d71-9cda-d2b1b1ac1107 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:29.176041 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-13533b93-1a1b-46d3-9791-603b84cb2ac1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:29.176971 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-13533b93-1a1b-46d3-9791-603b84cb2ac1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:29.183614 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-13533b93-1a1b-46d3-9791-603b84cb2ac1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:29.184053 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-13533b93-1a1b-46d3-9791-603b84cb2ac1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:29.184812 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-13533b93-1a1b-46d3-9791-603b84cb2ac1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:29.185396 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-13533b93-1a1b-46d3-9791-603b84cb2ac1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:29.415835 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-57822a04-2356-4d71-9cda-d2b1b1ac1107 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 821 microversion: 2.1 time: 0.269440 Aug 27 01:31:29.416457 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 110/235] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:31:29 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 821 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:31:29.422480 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-4ba7ef47-6076-42af-ab2d-b4df1d48a3ec tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:29.423193 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-4ba7ef47-6076-42af-ab2d-b4df1d48a3ec tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:29.430468 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4ba7ef47-6076-42af-ab2d-b4df1d48a3ec tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:29.430931 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4ba7ef47-6076-42af-ab2d-b4df1d48a3ec tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:29.431690 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4ba7ef47-6076-42af-ab2d-b4df1d48a3ec tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:29.432306 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4ba7ef47-6076-42af-ab2d-b4df1d48a3ec tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:29.470019 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-13533b93-1a1b-46d3-9791-603b84cb2ac1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 14 microversion: 2.20 time: 0.297515 Aug 27 01:31:29.473139 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 126/236] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:31:29 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 14 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:29.559691 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-4ba7ef47-6076-42af-ab2d-b4df1d48a3ec tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:29.567800 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-4ba7ef47-6076-42af-ab2d-b4df1d48a3ec tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.149929 Aug 27 01:31:29.568355 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 111/237] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:29 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:30.427162 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-f683b8c5-b90f-4ab2-842b-3ba65d73f8b4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:30.428183 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-f683b8c5-b90f-4ab2-842b-3ba65d73f8b4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:30.434990 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f683b8c5-b90f-4ab2-842b-3ba65d73f8b4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:30.435435 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f683b8c5-b90f-4ab2-842b-3ba65d73f8b4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:30.442471 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f683b8c5-b90f-4ab2-842b-3ba65d73f8b4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:30.442471 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f683b8c5-b90f-4ab2-842b-3ba65d73f8b4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:30.480783 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-5d8e56f0-b102-4052-bcc4-a32a26636400 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:30.481755 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-5d8e56f0-b102-4052-bcc4-a32a26636400 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:30.487973 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5d8e56f0-b102-4052-bcc4-a32a26636400 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:30.488406 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5d8e56f0-b102-4052-bcc4-a32a26636400 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:30.489174 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5d8e56f0-b102-4052-bcc4-a32a26636400 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:30.489605 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5d8e56f0-b102-4052-bcc4-a32a26636400 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:30.706310 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-f683b8c5-b90f-4ab2-842b-3ba65d73f8b4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 8354 microversion: 2.1 time: 0.283087 Aug 27 01:31:30.707048 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 127/238] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:31:30 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 8354 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:30.711902 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-6b030fe8-a692-47f3-98ce-aaf77b38d5eb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:30.712613 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-6b030fe8-a692-47f3-98ce-aaf77b38d5eb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:30.719056 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6b030fe8-a692-47f3-98ce-aaf77b38d5eb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:30.719503 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6b030fe8-a692-47f3-98ce-aaf77b38d5eb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:30.720300 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6b030fe8-a692-47f3-98ce-aaf77b38d5eb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:30.720739 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6b030fe8-a692-47f3-98ce-aaf77b38d5eb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:30.759466 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-5d8e56f0-b102-4052-bcc4-a32a26636400 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 247 microversion: 2.20 time: 0.282060 Aug 27 01:31:30.760228 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 112/239] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:31:30 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 247 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:31:30.847569 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-6b030fe8-a692-47f3-98ce-aaf77b38d5eb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:30.855103 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-6b030fe8-a692-47f3-98ce-aaf77b38d5eb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.146921 Aug 27 01:31:30.855707 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 128/240] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:30 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:31.717965 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-3e308b93-879a-43e4-af4d-fac1a99ea772 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:31.721236 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-3e308b93-879a-43e4-af4d-fac1a99ea772 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:31.725933 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3e308b93-879a-43e4-af4d-fac1a99ea772 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:31.726442 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3e308b93-879a-43e4-af4d-fac1a99ea772 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:31.727266 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3e308b93-879a-43e4-af4d-fac1a99ea772 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:31.727759 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3e308b93-879a-43e4-af4d-fac1a99ea772 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:31.770632 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-a8d11e46-f11b-4ec7-a5e4-548b03cfb9a5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:31.772931 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-a8d11e46-f11b-4ec7-a5e4-548b03cfb9a5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:31.777992 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a8d11e46-f11b-4ec7-a5e4-548b03cfb9a5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:31.778432 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a8d11e46-f11b-4ec7-a5e4-548b03cfb9a5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:31.779192 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a8d11e46-f11b-4ec7-a5e4-548b03cfb9a5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:31.779625 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a8d11e46-f11b-4ec7-a5e4-548b03cfb9a5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:32.029313 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-3e308b93-879a-43e4-af4d-fac1a99ea772 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 12411 microversion: 2.1 time: 0.173807 Aug 27 01:31:32.029313 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 113/241] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:31:31 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 12411 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:31:32.029313 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-f9a8ec38-c17e-4ef4-ae73-a64428400fb9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:32.029313 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-f9a8ec38-c17e-4ef4-ae73-a64428400fb9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:32.029313 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f9a8ec38-c17e-4ef4-ae73-a64428400fb9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:32.032113 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f9a8ec38-c17e-4ef4-ae73-a64428400fb9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:32.032113 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f9a8ec38-c17e-4ef4-ae73-a64428400fb9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:32.032113 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f9a8ec38-c17e-4ef4-ae73-a64428400fb9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:32.032297 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-a8d11e46-f11b-4ec7-a5e4-548b03cfb9a5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 6451 microversion: 2.20 time: 0.242636 Aug 27 01:31:32.032297 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 129/242] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:31:31 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 6451 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:31:32.032446 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-f9a8ec38-c17e-4ef4-ae73-a64428400fb9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:32.032446 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-f9a8ec38-c17e-4ef4-ae73-a64428400fb9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.138531 Aug 27 01:31:32.032446 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 114/243] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:31 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:33.023472 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-b66feee0-140f-4036-be7c-96d1ae24abf7 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:33.024146 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-f6214b81-0574-45e6-805e-39e4dfc24c68 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:33.024561 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-b66feee0-140f-4036-be7c-96d1ae24abf7 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:33.024909 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-f6214b81-0574-45e6-805e-39e4dfc24c68 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:33.030698 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b66feee0-140f-4036-be7c-96d1ae24abf7 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:33.031144 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b66feee0-140f-4036-be7c-96d1ae24abf7 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:33.031463 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f6214b81-0574-45e6-805e-39e4dfc24c68 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:33.031908 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b66feee0-140f-4036-be7c-96d1ae24abf7 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:33.032014 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f6214b81-0574-45e6-805e-39e4dfc24c68 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:33.032342 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b66feee0-140f-4036-be7c-96d1ae24abf7 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:33.032667 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f6214b81-0574-45e6-805e-39e4dfc24c68 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:33.033123 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f6214b81-0574-45e6-805e-39e4dfc24c68 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:33.197291 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-f6214b81-0574-45e6-805e-39e4dfc24c68 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 10235 microversion: 2.20 time: 0.177390 Aug 27 01:31:33.200749 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 130/244] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:31:33 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 10235 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:31:33.203001 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-09baba4a-6672-4199-a79d-96e1e4a1802a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:33.203691 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-09baba4a-6672-4199-a79d-96e1e4a1802a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:33.210025 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-09baba4a-6672-4199-a79d-96e1e4a1802a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:33.210470 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-09baba4a-6672-4199-a79d-96e1e4a1802a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:33.211234 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-09baba4a-6672-4199-a79d-96e1e4a1802a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:33.211665 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-09baba4a-6672-4199-a79d-96e1e4a1802a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:33.231300 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-b66feee0-140f-4036-be7c-96d1ae24abf7 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 15531 microversion: 2.1 time: 0.211459 Aug 27 01:31:33.232586 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 115/245] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:31:33 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 15531 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:31:33.338058 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-09baba4a-6672-4199-a79d-96e1e4a1802a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:33.345252 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-09baba4a-6672-4199-a79d-96e1e4a1802a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.146144 Aug 27 01:31:33.345854 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 131/246] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:33 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:34.209665 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-1f4f2463-9b22-4db6-b1de-6e9531b818a1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:34.210679 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-1f4f2463-9b22-4db6-b1de-6e9531b818a1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:34.217189 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1f4f2463-9b22-4db6-b1de-6e9531b818a1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:34.217693 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1f4f2463-9b22-4db6-b1de-6e9531b818a1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:34.218662 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1f4f2463-9b22-4db6-b1de-6e9531b818a1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:34.219091 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1f4f2463-9b22-4db6-b1de-6e9531b818a1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:34.243762 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-0161d1bf-7997-4e01-9f9f-9ddddf5d6949 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:34.244986 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-0161d1bf-7997-4e01-9f9f-9ddddf5d6949 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:34.252356 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0161d1bf-7997-4e01-9f9f-9ddddf5d6949 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:34.252749 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0161d1bf-7997-4e01-9f9f-9ddddf5d6949 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:34.253548 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0161d1bf-7997-4e01-9f9f-9ddddf5d6949 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:34.254001 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0161d1bf-7997-4e01-9f9f-9ddddf5d6949 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:34.380941 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-1f4f2463-9b22-4db6-b1de-6e9531b818a1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 13462 microversion: 2.20 time: 0.175718 Aug 27 01:31:34.381597 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 116/247] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:31:34 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 13462 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:31:34.386863 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ff47989c-7c18-4739-8925-ea621a674503 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:34.387542 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-ff47989c-7c18-4739-8925-ea621a674503 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:34.394942 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ff47989c-7c18-4739-8925-ea621a674503 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:34.395416 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ff47989c-7c18-4739-8925-ea621a674503 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:34.396202 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ff47989c-7c18-4739-8925-ea621a674503 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:34.396773 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ff47989c-7c18-4739-8925-ea621a674503 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:34.422950 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-0161d1bf-7997-4e01-9f9f-9ddddf5d6949 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 17602 microversion: 2.1 time: 0.182741 Aug 27 01:31:34.424029 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 132/248] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:31:34 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 17602 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:31:34.522422 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ff47989c-7c18-4739-8925-ea621a674503 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:34.529835 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-ff47989c-7c18-4739-8925-ea621a674503 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.146929 Aug 27 01:31:34.530607 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 117/249] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:34 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:35.393076 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-aa66524e-5374-4f2c-8966-a3127f41a047 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:35.394057 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-aa66524e-5374-4f2c-8966-a3127f41a047 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:35.400592 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-aa66524e-5374-4f2c-8966-a3127f41a047 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:35.404873 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-aa66524e-5374-4f2c-8966-a3127f41a047 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:35.404873 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-aa66524e-5374-4f2c-8966-a3127f41a047 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:35.404873 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-aa66524e-5374-4f2c-8966-a3127f41a047 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:35.435133 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-458ecdd6-2db7-4a07-8fec-1aa910003d8c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:35.436036 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-458ecdd6-2db7-4a07-8fec-1aa910003d8c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:35.442436 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-458ecdd6-2db7-4a07-8fec-1aa910003d8c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:35.442877 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-458ecdd6-2db7-4a07-8fec-1aa910003d8c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:35.443632 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-458ecdd6-2db7-4a07-8fec-1aa910003d8c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:35.444058 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-458ecdd6-2db7-4a07-8fec-1aa910003d8c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:35.588070 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-aa66524e-5374-4f2c-8966-a3127f41a047 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 16035 microversion: 2.20 time: 0.199106 Aug 27 01:31:35.589570 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 133/250] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:31:35 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 16035 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:31:35.598601 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-65ea335e-b493-4a3e-809c-b717ab395d2d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:35.598601 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-65ea335e-b493-4a3e-809c-b717ab395d2d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:35.603133 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-65ea335e-b493-4a3e-809c-b717ab395d2d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:35.603580 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-65ea335e-b493-4a3e-809c-b717ab395d2d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:35.604413 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-65ea335e-b493-4a3e-809c-b717ab395d2d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:35.604861 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-65ea335e-b493-4a3e-809c-b717ab395d2d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:35.641783 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-458ecdd6-2db7-4a07-8fec-1aa910003d8c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 17602 microversion: 2.1 time: 0.210124 Aug 27 01:31:35.642422 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 118/251] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:31:35 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 17602 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:31:35.734085 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-65ea335e-b493-4a3e-809c-b717ab395d2d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:35.741695 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-65ea335e-b493-4a3e-809c-b717ab395d2d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.150697 Aug 27 01:31:35.742248 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 134/252] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:35 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:36.600304 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c4f9974d-cb3f-42d4-8d04-54e2a6b6e69d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:36.601335 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c4f9974d-cb3f-42d4-8d04-54e2a6b6e69d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:36.608130 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c4f9974d-cb3f-42d4-8d04-54e2a6b6e69d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:36.608506 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c4f9974d-cb3f-42d4-8d04-54e2a6b6e69d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:36.609340 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c4f9974d-cb3f-42d4-8d04-54e2a6b6e69d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:36.609769 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c4f9974d-cb3f-42d4-8d04-54e2a6b6e69d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:36.652716 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-c755c01f-6eda-4ba4-9118-14f53ab205f6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:36.653682 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-c755c01f-6eda-4ba4-9118-14f53ab205f6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:36.660017 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c755c01f-6eda-4ba4-9118-14f53ab205f6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:36.660464 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c755c01f-6eda-4ba4-9118-14f53ab205f6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:36.661258 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c755c01f-6eda-4ba4-9118-14f53ab205f6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:36.661692 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c755c01f-6eda-4ba4-9118-14f53ab205f6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:39.713979 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c4f9974d-cb3f-42d4-8d04-54e2a6b6e69d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 19342 microversion: 2.20 time: 3.117432 Aug 27 01:31:39.717646 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 119/253] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:31:36 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 19342 bytes in 3119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:31:39.720426 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-50ce1dc6-0de5-40da-be61-3cf85e5bdf8b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:39.721142 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-50ce1dc6-0de5-40da-be61-3cf85e5bdf8b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:39.727382 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-50ce1dc6-0de5-40da-be61-3cf85e5bdf8b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:39.727821 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-50ce1dc6-0de5-40da-be61-3cf85e5bdf8b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:39.728582 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-50ce1dc6-0de5-40da-be61-3cf85e5bdf8b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:39.729035 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-50ce1dc6-0de5-40da-be61-3cf85e5bdf8b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:39.753490 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-c755c01f-6eda-4ba4-9118-14f53ab205f6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 22853 microversion: 2.1 time: 3.104215 Aug 27 01:31:39.754835 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 135/254] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:31:36 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 22853 bytes in 3106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:31:39.860913 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-50ce1dc6-0de5-40da-be61-3cf85e5bdf8b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:39.868688 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-50ce1dc6-0de5-40da-be61-3cf85e5bdf8b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.152592 Aug 27 01:31:39.869317 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 120/255] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:39 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:40.726078 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-40983970-090a-4207-8008-1b362a9f4f99 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:40.727252 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-40983970-090a-4207-8008-1b362a9f4f99 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:40.734725 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-40983970-090a-4207-8008-1b362a9f4f99 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:40.735168 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-40983970-090a-4207-8008-1b362a9f4f99 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:40.735971 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-40983970-090a-4207-8008-1b362a9f4f99 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:40.736398 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-40983970-090a-4207-8008-1b362a9f4f99 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:40.765667 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-985a9a59-2aae-4cd1-85c5-a9579be8c8e6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:40.766780 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-985a9a59-2aae-4cd1-85c5-a9579be8c8e6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:40.773369 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-985a9a59-2aae-4cd1-85c5-a9579be8c8e6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:40.774025 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-985a9a59-2aae-4cd1-85c5-a9579be8c8e6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:40.774983 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-985a9a59-2aae-4cd1-85c5-a9579be8c8e6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:40.775471 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-985a9a59-2aae-4cd1-85c5-a9579be8c8e6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:40.903556 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-40983970-090a-4207-8008-1b362a9f4f99 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 21394 microversion: 2.20 time: 0.181464 Aug 27 01:31:40.904192 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 136/256] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:31:40 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 21394 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:31:40.909473 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-45cf6b7c-2fd1-4271-82ea-d3a224b6460d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:40.910147 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-45cf6b7c-2fd1-4271-82ea-d3a224b6460d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:40.916372 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-45cf6b7c-2fd1-4271-82ea-d3a224b6460d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:40.916839 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-45cf6b7c-2fd1-4271-82ea-d3a224b6460d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:40.917610 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-45cf6b7c-2fd1-4271-82ea-d3a224b6460d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:40.919383 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-45cf6b7c-2fd1-4271-82ea-d3a224b6460d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:40.937975 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-985a9a59-2aae-4cd1-85c5-a9579be8c8e6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 23234 microversion: 2.1 time: 0.175556 Aug 27 01:31:40.938738 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 121/257] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:31:40 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 23234 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:31:41.039011 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-45cf6b7c-2fd1-4271-82ea-d3a224b6460d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:41.047135 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-45cf6b7c-2fd1-4271-82ea-d3a224b6460d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.141177 Aug 27 01:31:41.048051 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 137/258] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:40 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:41.924316 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-f9407551-9e48-4f1a-abd8-1825f8fa543a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:41.925690 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-f9407551-9e48-4f1a-abd8-1825f8fa543a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:41.935257 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f9407551-9e48-4f1a-abd8-1825f8fa543a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:41.935735 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f9407551-9e48-4f1a-abd8-1825f8fa543a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:41.936581 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f9407551-9e48-4f1a-abd8-1825f8fa543a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:41.937130 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f9407551-9e48-4f1a-abd8-1825f8fa543a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:41.949022 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-e0fa356b-d789-4cf5-bc00-0eb3ada23eaf tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:41.950077 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-e0fa356b-d789-4cf5-bc00-0eb3ada23eaf tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:41.956712 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e0fa356b-d789-4cf5-bc00-0eb3ada23eaf tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:41.957314 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e0fa356b-d789-4cf5-bc00-0eb3ada23eaf tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:41.958152 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e0fa356b-d789-4cf5-bc00-0eb3ada23eaf tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:41.958996 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e0fa356b-d789-4cf5-bc00-0eb3ada23eaf tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:42.257960 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-f9407551-9e48-4f1a-abd8-1825f8fa543a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 22784 microversion: 2.20 time: 0.344509 Aug 27 01:31:42.262669 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 122/259] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:31:41 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 22784 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:31:42.263364 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-93f9a8c1-4c90-4b5d-8ed1-d31fc63cc5fe tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:42.264045 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-93f9a8c1-4c90-4b5d-8ed1-d31fc63cc5fe tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:42.270479 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-93f9a8c1-4c90-4b5d-8ed1-d31fc63cc5fe tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:42.270939 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-93f9a8c1-4c90-4b5d-8ed1-d31fc63cc5fe tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:42.271700 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-93f9a8c1-4c90-4b5d-8ed1-d31fc63cc5fe tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:42.272176 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-93f9a8c1-4c90-4b5d-8ed1-d31fc63cc5fe tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:42.295658 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-e0fa356b-d789-4cf5-bc00-0eb3ada23eaf tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 24174 microversion: 2.1 time: 0.349959 Aug 27 01:31:42.297691 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 138/260] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:31:41 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 24174 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:31:42.393704 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-93f9a8c1-4c90-4b5d-8ed1-d31fc63cc5fe tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:42.401297 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-93f9a8c1-4c90-4b5d-8ed1-d31fc63cc5fe tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.141529 Aug 27 01:31:42.403196 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 123/261] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:42 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:42.963325 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d7b1dcc1-fa2a-47d5-9f02-79cdd3040d12 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1792332883", "imageRef": "6660bea6-dee9-43b4-95ef-29b53e1a2b28", "flavorRef": "452", "networks": [{"uuid": "0794f498-7c79-4c04-9426-97a5145b6e4e"}]}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:43.014024 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.network.neutron [None req-d7b1dcc1-fa2a-47d5-9f02-79cdd3040d12 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] validate_networks() for [('0794f498-7c79-4c04-9426-97a5145b6e4e', None, None, None, None, None)] {{(pid=108755) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 01:31:43.270564 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-24cfee7e-5641-4079-88c8-65296aaed19d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:43.271472 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-24cfee7e-5641-4079-88c8-65296aaed19d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:43.277554 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-24cfee7e-5641-4079-88c8-65296aaed19d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:43.278003 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-24cfee7e-5641-4079-88c8-65296aaed19d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:43.278919 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-24cfee7e-5641-4079-88c8-65296aaed19d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:43.279253 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-24cfee7e-5641-4079-88c8-65296aaed19d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:43.376496 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.virt.hardware [None req-d7b1dcc1-fa2a-47d5-9f02-79cdd3040d12 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Flavor limits 0:0:0 {{(pid=108755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 01:31:43.376955 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.virt.hardware [None req-d7b1dcc1-fa2a-47d5-9f02-79cdd3040d12 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Image limits 0:0:0 {{(pid=108755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 01:31:43.377421 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.virt.hardware [None req-d7b1dcc1-fa2a-47d5-9f02-79cdd3040d12 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Flavor pref 0:0:0 {{(pid=108755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 01:31:43.377821 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.virt.hardware [None req-d7b1dcc1-fa2a-47d5-9f02-79cdd3040d12 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Image pref 0:0:0 {{(pid=108755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 01:31:43.378535 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.virt.hardware [None req-d7b1dcc1-fa2a-47d5-9f02-79cdd3040d12 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 01:31:43.387000 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d7b1dcc1-fa2a-47d5-9f02-79cdd3040d12 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:43.387444 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d7b1dcc1-fa2a-47d5-9f02-79cdd3040d12 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:43.388234 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d7b1dcc1-fa2a-47d5-9f02-79cdd3040d12 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:43.388663 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d7b1dcc1-fa2a-47d5-9f02-79cdd3040d12 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:43.404689 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-d7b1dcc1-fa2a-47d5-9f02-79cdd3040d12 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Getting quotas for project 8c9439f7236d4228aea4ccc73e5d6c08. Resources: {'ram', 'instances', 'cores'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:31:43.409195 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-d7b1dcc1-fa2a-47d5-9f02-79cdd3040d12 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Getting quotas for user 589eca6a184e4505a0c0f97efe65892e and project 8c9439f7236d4228aea4ccc73e5d6c08. Resources: {'ram', 'instances', 'cores'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:31:43.420328 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d7b1dcc1-fa2a-47d5-9f02-79cdd3040d12 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Going to run 1 instances... {{(pid=108755) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 01:31:43.423839 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d7b1dcc1-fa2a-47d5-9f02-79cdd3040d12 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 6e8afedf-7eb5-446f-a22d-1412c3a11039] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6660bea6-dee9-43b4-95ef-29b53e1a2b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 01:31:43.446812 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-24cfee7e-5641-4079-88c8-65296aaed19d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 23593 microversion: 2.20 time: 0.179731 Aug 27 01:31:43.447454 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 124/262] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:31:43 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 23593 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 01:31:43.452480 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-950e5bac-6617-4515-80b5-bb5a82d0b82a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:43.454083 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-950e5bac-6617-4515-80b5-bb5a82d0b82a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:43.460587 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-950e5bac-6617-4515-80b5-bb5a82d0b82a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:43.461980 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-950e5bac-6617-4515-80b5-bb5a82d0b82a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:43.461980 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-950e5bac-6617-4515-80b5-bb5a82d0b82a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:43.462428 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-950e5bac-6617-4515-80b5-bb5a82d0b82a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:43.603680 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-950e5bac-6617-4515-80b5-bb5a82d0b82a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 24795 microversion: 2.1 time: 0.154691 Aug 27 01:31:43.604547 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d7b1dcc1-fa2a-47d5-9f02-79cdd3040d12 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.644880 Aug 27 01:31:43.604696 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 125/263] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:31:43 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 24795 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:31:43.607445 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 139/264] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Aug 27 01:31:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 01:31:43.611510 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c741aa91-e8e7-4f8c-b810-dc2567f061ca tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:43.612205 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c741aa91-e8e7-4f8c-b810-dc2567f061ca tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:43.615293 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-84f7701a-92c2-492d-adbf-4c5d4ba097b5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:43.615902 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-84f7701a-92c2-492d-adbf-4c5d4ba097b5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 6e8afedf-7eb5-446f-a22d-1412c3a11039] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:43.618746 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c741aa91-e8e7-4f8c-b810-dc2567f061ca tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:43.618864 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c741aa91-e8e7-4f8c-b810-dc2567f061ca tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:43.619611 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c741aa91-e8e7-4f8c-b810-dc2567f061ca tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:43.620033 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c741aa91-e8e7-4f8c-b810-dc2567f061ca tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:43.689812 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-84f7701a-92c2-492d-adbf-4c5d4ba097b5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:43.696601 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-84f7701a-92c2-492d-adbf-4c5d4ba097b5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039" status: 200 len: 1218 microversion: 2.1 time: 0.084801 Aug 27 01:31:43.701426 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 140/265] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:43 2021] GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:43.772906 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c741aa91-e8e7-4f8c-b810-dc2567f061ca tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:43.782848 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c741aa91-e8e7-4f8c-b810-dc2567f061ca tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.176037 Aug 27 01:31:43.783575 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 126/266] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:43 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:44.463070 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-2820c95c-cd89-4b2f-b707-f5105ec96838 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:44.465064 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-2820c95c-cd89-4b2f-b707-f5105ec96838 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:44.477763 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2820c95c-cd89-4b2f-b707-f5105ec96838 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:44.478629 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2820c95c-cd89-4b2f-b707-f5105ec96838 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:44.481262 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2820c95c-cd89-4b2f-b707-f5105ec96838 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:44.482079 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2820c95c-cd89-4b2f-b707-f5105ec96838 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:44.616046 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-97811c4c-fd6b-4438-ba57-c5d2cc562d4a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:44.617082 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-97811c4c-fd6b-4438-ba57-c5d2cc562d4a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:44.623652 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-97811c4c-fd6b-4438-ba57-c5d2cc562d4a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:44.624123 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-97811c4c-fd6b-4438-ba57-c5d2cc562d4a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:44.626604 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-97811c4c-fd6b-4438-ba57-c5d2cc562d4a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:44.627256 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-97811c4c-fd6b-4438-ba57-c5d2cc562d4a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:44.645347 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-2820c95c-cd89-4b2f-b707-f5105ec96838 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 24311 microversion: 2.20 time: 0.189071 Aug 27 01:31:44.646065 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 141/267] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:31:44 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 24311 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:31:44.719058 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b2f4ad33-afeb-4e9b-b707-402e873c918c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:44.719669 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b2f4ad33-afeb-4e9b-b707-402e873c918c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 6e8afedf-7eb5-446f-a22d-1412c3a11039] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:44.726133 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b2f4ad33-afeb-4e9b-b707-402e873c918c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:44.726575 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b2f4ad33-afeb-4e9b-b707-402e873c918c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:44.727344 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b2f4ad33-afeb-4e9b-b707-402e873c918c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:44.727776 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b2f4ad33-afeb-4e9b-b707-402e873c918c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:44.753958 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-97811c4c-fd6b-4438-ba57-c5d2cc562d4a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 25490 microversion: 2.1 time: 0.141539 Aug 27 01:31:44.754971 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 127/268] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:31:44 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 25490 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:31:44.801922 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-f32bc243-6202-484e-90ab-22f6aac48429 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:44.803794 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-f32bc243-6202-484e-90ab-22f6aac48429 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:44.815238 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f32bc243-6202-484e-90ab-22f6aac48429 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:44.816292 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f32bc243-6202-484e-90ab-22f6aac48429 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:44.817254 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f32bc243-6202-484e-90ab-22f6aac48429 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:44.817689 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f32bc243-6202-484e-90ab-22f6aac48429 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:44.823722 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-b2f4ad33-afeb-4e9b-b707-402e873c918c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:44.833328 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b2f4ad33-afeb-4e9b-b707-402e873c918c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039" status: 200 len: 1222 microversion: 2.1 time: 0.118048 Aug 27 01:31:44.833891 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 142/269] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:44 2021] GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039 => generated 1222 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:45.012855 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-f32bc243-6202-484e-90ab-22f6aac48429 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:45.021723 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-f32bc243-6202-484e-90ab-22f6aac48429 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.225538 Aug 27 01:31:45.022289 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 128/270] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:44 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:45.657916 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-773ae376-9751-4245-b0d7-8ecb9527e978 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:45.658831 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-773ae376-9751-4245-b0d7-8ecb9527e978 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:45.664569 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-773ae376-9751-4245-b0d7-8ecb9527e978 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:45.665055 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-773ae376-9751-4245-b0d7-8ecb9527e978 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:45.665816 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-773ae376-9751-4245-b0d7-8ecb9527e978 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:45.666330 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-773ae376-9751-4245-b0d7-8ecb9527e978 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:45.766462 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-2f5c0d7d-0101-4e6c-9c7d-f3f227cfa94a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:45.767444 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-2f5c0d7d-0101-4e6c-9c7d-f3f227cfa94a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:45.776050 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2f5c0d7d-0101-4e6c-9c7d-f3f227cfa94a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:45.776514 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2f5c0d7d-0101-4e6c-9c7d-f3f227cfa94a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:45.777364 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2f5c0d7d-0101-4e6c-9c7d-f3f227cfa94a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:45.777804 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2f5c0d7d-0101-4e6c-9c7d-f3f227cfa94a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:45.918152 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-773ae376-9751-4245-b0d7-8ecb9527e978 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 24861 microversion: 2.20 time: 0.264287 Aug 27 01:31:45.918715 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 143/271] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:31:45 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 24861 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:31:45.924321 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-2bb9da4f-aad6-440e-8be4-3eda2f13959e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:45.925027 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-2bb9da4f-aad6-440e-8be4-3eda2f13959e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 6e8afedf-7eb5-446f-a22d-1412c3a11039] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:45.931602 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2bb9da4f-aad6-440e-8be4-3eda2f13959e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:45.932037 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2bb9da4f-aad6-440e-8be4-3eda2f13959e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:45.932788 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2bb9da4f-aad6-440e-8be4-3eda2f13959e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:45.933234 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2bb9da4f-aad6-440e-8be4-3eda2f13959e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:45.969132 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-2f5c0d7d-0101-4e6c-9c7d-f3f227cfa94a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 25929 microversion: 2.1 time: 0.206144 Aug 27 01:31:45.969827 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 129/272] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:31:45 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 25929 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:31:45.996869 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-2bb9da4f-aad6-440e-8be4-3eda2f13959e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:46.006134 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-2bb9da4f-aad6-440e-8be4-3eda2f13959e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039" status: 200 len: 1270 microversion: 2.1 time: 0.086255 Aug 27 01:31:46.006863 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 144/273] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:45 2021] GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039 => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:46.045821 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-8189a3de-0721-471f-8cab-ec8ef56d65e7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:46.045821 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-8189a3de-0721-471f-8cab-ec8ef56d65e7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:46.054027 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8189a3de-0721-471f-8cab-ec8ef56d65e7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:46.055391 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8189a3de-0721-471f-8cab-ec8ef56d65e7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:46.056191 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8189a3de-0721-471f-8cab-ec8ef56d65e7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:46.056810 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8189a3de-0721-471f-8cab-ec8ef56d65e7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:46.187067 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-8189a3de-0721-471f-8cab-ec8ef56d65e7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:46.199380 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-8189a3de-0721-471f-8cab-ec8ef56d65e7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.160229 Aug 27 01:31:46.199990 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 130/274] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:46 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:46.930595 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-fb001f86-2941-4d44-a6ae-0cd88fcf25fb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:46.931529 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-fb001f86-2941-4d44-a6ae-0cd88fcf25fb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:46.938800 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fb001f86-2941-4d44-a6ae-0cd88fcf25fb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:46.939419 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fb001f86-2941-4d44-a6ae-0cd88fcf25fb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:46.940600 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fb001f86-2941-4d44-a6ae-0cd88fcf25fb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:46.941258 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fb001f86-2941-4d44-a6ae-0cd88fcf25fb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:46.981713 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-f8c60b77-fe3d-4557-8df3-489e69021ff0 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:46.982882 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-f8c60b77-fe3d-4557-8df3-489e69021ff0 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:46.990916 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f8c60b77-fe3d-4557-8df3-489e69021ff0 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:46.991165 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f8c60b77-fe3d-4557-8df3-489e69021ff0 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:46.992272 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f8c60b77-fe3d-4557-8df3-489e69021ff0 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:46.993021 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f8c60b77-fe3d-4557-8df3-489e69021ff0 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:47.195239 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-fb001f86-2941-4d44-a6ae-0cd88fcf25fb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 25643 microversion: 2.20 time: 0.267071 Aug 27 01:31:47.197514 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 145/275] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:31:46 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 25643 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:31:47.205100 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-6212facc-f302-4029-bf05-f209ffb86949 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:47.207100 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-6212facc-f302-4029-bf05-f209ffb86949 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 6e8afedf-7eb5-446f-a22d-1412c3a11039] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:47.215977 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6212facc-f302-4029-bf05-f209ffb86949 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:47.217102 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6212facc-f302-4029-bf05-f209ffb86949 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:47.218759 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6212facc-f302-4029-bf05-f209ffb86949 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:47.219269 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6212facc-f302-4029-bf05-f209ffb86949 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:47.228604 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-f8c60b77-fe3d-4557-8df3-489e69021ff0 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 26434 microversion: 2.1 time: 0.252217 Aug 27 01:31:47.229616 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 131/276] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:31:46 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 26434 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:31:47.236316 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-736803ff-235c-40f7-8742-6fa51e7003c9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:47.237388 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-736803ff-235c-40f7-8742-6fa51e7003c9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:47.247294 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-736803ff-235c-40f7-8742-6fa51e7003c9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:47.259907 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-736803ff-235c-40f7-8742-6fa51e7003c9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:47.259907 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-736803ff-235c-40f7-8742-6fa51e7003c9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:47.259907 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-736803ff-235c-40f7-8742-6fa51e7003c9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:47.395871 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-736803ff-235c-40f7-8742-6fa51e7003c9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:47.404467 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-736803ff-235c-40f7-8742-6fa51e7003c9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.173373 Aug 27 01:31:47.405999 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 132/277] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:47 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:47.585668 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-6212facc-f302-4029-bf05-f209ffb86949 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:47.593527 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-6212facc-f302-4029-bf05-f209ffb86949 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039" status: 200 len: 1318 microversion: 2.1 time: 0.394095 Aug 27 01:31:47.594209 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 146/278] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:47 2021] GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039 => generated 1318 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:48.209750 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-31e63775-0a41-48a5-ae20-835fdf4a85d9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:48.209750 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-31e63775-0a41-48a5-ae20-835fdf4a85d9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:48.214360 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-12be6352-58dd-4174-a240-5396161c6a68 req-56d3e016-5a23-4837-b90f-2e22d886ad88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e8afedf-7eb5-446f-a22d-1412c3a11039", "tag": "cd19f281-5f24-4728-b09e-57bb575f8a48"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:48.220941 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:31:48.220941 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:31:48.236583 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-31e63775-0a41-48a5-ae20-835fdf4a85d9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:48.237103 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-31e63775-0a41-48a5-ae20-835fdf4a85d9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:48.237885 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-31e63775-0a41-48a5-ae20-835fdf4a85d9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:48.238312 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-31e63775-0a41-48a5-ae20-835fdf4a85d9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:48.240672 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-12be6352-58dd-4174-a240-5396161c6a68 req-56d3e016-5a23-4837-b90f-2e22d886ad88 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:48.244777 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-12be6352-58dd-4174-a240-5396161c6a68 req-56d3e016-5a23-4837-b90f-2e22d886ad88 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:48.267368 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-12be6352-58dd-4174-a240-5396161c6a68 req-56d3e016-5a23-4837-b90f-2e22d886ad88 service nova] Creating event network-changed:cd19f281-5f24-4728-b09e-57bb575f8a48 for instance 6e8afedf-7eb5-446f-a22d-1412c3a11039 on hv-cinder-75916 Aug 27 01:31:48.274051 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-12be6352-58dd-4174-a240-5396161c6a68 req-56d3e016-5a23-4837-b90f-2e22d886ad88 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061666 Aug 27 01:31:48.277767 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 147/279] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:31:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:31:48.283899 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-c9685740-1569-43ea-8e1c-854ef4b27f1b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:48.284972 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-c9685740-1569-43ea-8e1c-854ef4b27f1b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:48.292243 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c9685740-1569-43ea-8e1c-854ef4b27f1b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:48.292696 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c9685740-1569-43ea-8e1c-854ef4b27f1b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:48.293501 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c9685740-1569-43ea-8e1c-854ef4b27f1b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:48.293943 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c9685740-1569-43ea-8e1c-854ef4b27f1b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:48.453476 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-31e63775-0a41-48a5-ae20-835fdf4a85d9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 26252 microversion: 2.20 time: 0.248994 Aug 27 01:31:48.454265 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 133/280] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:31:48 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 26252 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:31:48.459107 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-7874f7e0-693d-4314-9dc9-e0ebea50161f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:48.459794 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-7874f7e0-693d-4314-9dc9-e0ebea50161f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:48.466996 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7874f7e0-693d-4314-9dc9-e0ebea50161f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:48.467447 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7874f7e0-693d-4314-9dc9-e0ebea50161f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:48.468771 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7874f7e0-693d-4314-9dc9-e0ebea50161f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:48.469414 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7874f7e0-693d-4314-9dc9-e0ebea50161f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:48.532884 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-c9685740-1569-43ea-8e1c-854ef4b27f1b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 26928 microversion: 2.1 time: 0.253232 Aug 27 01:31:48.535102 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 148/281] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:31:48 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 26928 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:31:48.611310 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-43ced941-1f4a-4d18-abf9-c027a9887630 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:48.612385 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-43ced941-1f4a-4d18-abf9-c027a9887630 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 6e8afedf-7eb5-446f-a22d-1412c3a11039] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:48.620136 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-7874f7e0-693d-4314-9dc9-e0ebea50161f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:48.622330 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-43ced941-1f4a-4d18-abf9-c027a9887630 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:48.623088 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-43ced941-1f4a-4d18-abf9-c027a9887630 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:48.624079 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-43ced941-1f4a-4d18-abf9-c027a9887630 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:48.625452 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-43ced941-1f4a-4d18-abf9-c027a9887630 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:48.628196 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-7874f7e0-693d-4314-9dc9-e0ebea50161f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.172744 Aug 27 01:31:48.637158 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 134/282] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:48 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:48.836353 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-43ced941-1f4a-4d18-abf9-c027a9887630 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:48.844949 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-43ced941-1f4a-4d18-abf9-c027a9887630 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039" status: 200 len: 1318 microversion: 2.1 time: 0.237894 Aug 27 01:31:48.845506 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 149/283] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:48 2021] GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:49.464778 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-7f264723-bee7-4b72-8070-caadc48dda4a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:49.465747 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-7f264723-bee7-4b72-8070-caadc48dda4a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:49.472514 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7f264723-bee7-4b72-8070-caadc48dda4a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:49.473000 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7f264723-bee7-4b72-8070-caadc48dda4a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:49.473762 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7f264723-bee7-4b72-8070-caadc48dda4a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:49.474195 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7f264723-bee7-4b72-8070-caadc48dda4a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:49.551650 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-5a0fb34e-4621-4855-a689-ed02c847c24a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:49.552563 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-5a0fb34e-4621-4855-a689-ed02c847c24a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:49.559891 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5a0fb34e-4621-4855-a689-ed02c847c24a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:49.560475 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5a0fb34e-4621-4855-a689-ed02c847c24a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:49.562377 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5a0fb34e-4621-4855-a689-ed02c847c24a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:49.562814 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5a0fb34e-4621-4855-a689-ed02c847c24a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:49.676259 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-7f264723-bee7-4b72-8070-caadc48dda4a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 26839 microversion: 2.20 time: 0.214809 Aug 27 01:31:49.677442 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 135/284] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:31:49 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 26839 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:31:49.683283 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-e5bdf4ba-1581-42a8-aed0-e6c8e711c1c0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:49.683975 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-e5bdf4ba-1581-42a8-aed0-e6c8e711c1c0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:49.691445 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e5bdf4ba-1581-42a8-aed0-e6c8e711c1c0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:49.692234 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e5bdf4ba-1581-42a8-aed0-e6c8e711c1c0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:49.693480 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e5bdf4ba-1581-42a8-aed0-e6c8e711c1c0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:49.694118 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e5bdf4ba-1581-42a8-aed0-e6c8e711c1c0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:49.754844 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-5a0fb34e-4621-4855-a689-ed02c847c24a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 27207 microversion: 2.1 time: 0.212242 Aug 27 01:31:49.756414 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 150/285] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:31:49 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 27207 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:31:49.831143 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-e5bdf4ba-1581-42a8-aed0-e6c8e711c1c0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:49.838329 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-e5bdf4ba-1581-42a8-aed0-e6c8e711c1c0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.159461 Aug 27 01:31:49.838882 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 136/286] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:49 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:49.862654 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-f379d7ad-ae40-4ae6-9e21-428445adb037 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:49.863355 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-f379d7ad-ae40-4ae6-9e21-428445adb037 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 6e8afedf-7eb5-446f-a22d-1412c3a11039] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:49.870184 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f379d7ad-ae40-4ae6-9e21-428445adb037 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:49.870633 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f379d7ad-ae40-4ae6-9e21-428445adb037 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:49.871408 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f379d7ad-ae40-4ae6-9e21-428445adb037 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:49.871846 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f379d7ad-ae40-4ae6-9e21-428445adb037 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:50.015572 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-f379d7ad-ae40-4ae6-9e21-428445adb037 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:50.023455 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-f379d7ad-ae40-4ae6-9e21-428445adb037 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039" status: 200 len: 1318 microversion: 2.1 time: 0.165878 Aug 27 01:31:50.024018 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 151/287] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:49 2021] GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:50.688575 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-6ac4a440-5652-4cfa-869e-fae5032d822a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:50.689507 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-6ac4a440-5652-4cfa-869e-fae5032d822a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:50.695866 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6ac4a440-5652-4cfa-869e-fae5032d822a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:50.696395 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6ac4a440-5652-4cfa-869e-fae5032d822a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:50.697182 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6ac4a440-5652-4cfa-869e-fae5032d822a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:50.697610 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6ac4a440-5652-4cfa-869e-fae5032d822a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:50.767979 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-2ad921c7-85d9-4e83-a295-9d1c9c5136cc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:50.769136 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-2ad921c7-85d9-4e83-a295-9d1c9c5136cc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:50.775655 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2ad921c7-85d9-4e83-a295-9d1c9c5136cc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:50.775901 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2ad921c7-85d9-4e83-a295-9d1c9c5136cc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:50.776871 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2ad921c7-85d9-4e83-a295-9d1c9c5136cc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:50.777309 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2ad921c7-85d9-4e83-a295-9d1c9c5136cc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:50.851330 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-6ac4a440-5652-4cfa-869e-fae5032d822a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 27164 microversion: 2.20 time: 0.166378 Aug 27 01:31:50.852125 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 137/288] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:31:50 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 27164 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:31:50.863115 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-1f3b46ee-0230-4f97-a204-40fd5e98a524 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:50.863825 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-1f3b46ee-0230-4f97-a204-40fd5e98a524 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:50.870477 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1f3b46ee-0230-4f97-a204-40fd5e98a524 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:50.873273 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1f3b46ee-0230-4f97-a204-40fd5e98a524 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:50.873273 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1f3b46ee-0230-4f97-a204-40fd5e98a524 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:50.873273 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1f3b46ee-0230-4f97-a204-40fd5e98a524 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:50.988335 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-2ad921c7-85d9-4e83-a295-9d1c9c5136cc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 27598 microversion: 2.1 time: 0.224720 Aug 27 01:31:50.989013 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 152/289] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:31:50 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 27598 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:31:50.995331 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-1f3b46ee-0230-4f97-a204-40fd5e98a524 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:51.002603 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-1f3b46ee-0230-4f97-a204-40fd5e98a524 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.144487 Aug 27 01:31:51.003155 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 138/290] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:50 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:51.041669 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-018ebca7-10b4-4985-9fe5-d0d03bcdd0c4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:51.042357 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-018ebca7-10b4-4985-9fe5-d0d03bcdd0c4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 6e8afedf-7eb5-446f-a22d-1412c3a11039] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:51.049490 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-018ebca7-10b4-4985-9fe5-d0d03bcdd0c4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:51.049939 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-018ebca7-10b4-4985-9fe5-d0d03bcdd0c4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:51.050708 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-018ebca7-10b4-4985-9fe5-d0d03bcdd0c4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:51.053273 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-018ebca7-10b4-4985-9fe5-d0d03bcdd0c4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:51.176719 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-018ebca7-10b4-4985-9fe5-d0d03bcdd0c4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:51.184180 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-018ebca7-10b4-4985-9fe5-d0d03bcdd0c4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039" status: 200 len: 1318 microversion: 2.1 time: 0.146492 Aug 27 01:31:51.187273 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 153/291] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:51 2021] GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:51.663582 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-89a8b159-34d9-4548-962f-78e9a488f127 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:51.664065 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-89a8b159-34d9-4548-962f-78e9a488f127 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:51.669999 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-89a8b159-34d9-4548-962f-78e9a488f127 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:51.670377 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-89a8b159-34d9-4548-962f-78e9a488f127 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:51.671198 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-89a8b159-34d9-4548-962f-78e9a488f127 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:51.671813 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-89a8b159-34d9-4548-962f-78e9a488f127 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:51.700771 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-89a8b159-34d9-4548-962f-78e9a488f127 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Going to try to terminate instance {{(pid=108756) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 01:31:51.863024 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d57a0d8a-7fb6-4740-88d2-73f618f5cc4e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:51.867324 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d57a0d8a-7fb6-4740-88d2-73f618f5cc4e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:51.870789 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d57a0d8a-7fb6-4740-88d2-73f618f5cc4e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:51.871406 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d57a0d8a-7fb6-4740-88d2-73f618f5cc4e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:51.872159 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d57a0d8a-7fb6-4740-88d2-73f618f5cc4e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:51.872632 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d57a0d8a-7fb6-4740-88d2-73f618f5cc4e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:52.041156 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d57a0d8a-7fb6-4740-88d2-73f618f5cc4e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 27629 microversion: 2.20 time: 0.182488 Aug 27 01:31:52.042730 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 154/292] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:31:51 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 27629 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 01:31:52.047463 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-2b726c19-a850-41e8-b035-a18aba81deb4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:52.048459 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-2b726c19-a850-41e8-b035-a18aba81deb4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:52.055166 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2b726c19-a850-41e8-b035-a18aba81deb4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:52.055864 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2b726c19-a850-41e8-b035-a18aba81deb4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:52.056362 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2b726c19-a850-41e8-b035-a18aba81deb4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:52.056796 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2b726c19-a850-41e8-b035-a18aba81deb4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:52.077909 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-89a8b159-34d9-4548-962f-78e9a488f127 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 204 len: 0 microversion: 2.1 time: 0.417547 Aug 27 01:31:52.079350 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 139/293] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Aug 27 01:31:51 2021] DELETE /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 01:31:52.086324 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ddb61f60-4f16-4976-b6fc-441861c2d1d3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:52.087133 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-ddb61f60-4f16-4976-b6fc-441861c2d1d3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:52.093891 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ddb61f60-4f16-4976-b6fc-441861c2d1d3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:52.094507 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ddb61f60-4f16-4976-b6fc-441861c2d1d3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:52.095348 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ddb61f60-4f16-4976-b6fc-441861c2d1d3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:52.098254 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ddb61f60-4f16-4976-b6fc-441861c2d1d3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:52.221286 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ddb61f60-4f16-4976-b6fc-441861c2d1d3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:52.228746 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-ddb61f60-4f16-4976-b6fc-441861c2d1d3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.148472 Aug 27 01:31:52.229760 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 140/294] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:52 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:52.234993 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-203d794e-e4ac-496b-a8e2-ea6626598e7e tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:52.235658 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-203d794e-e4ac-496b-a8e2-ea6626598e7e tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:52.241568 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-203d794e-e4ac-496b-a8e2-ea6626598e7e tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:52.242008 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-203d794e-e4ac-496b-a8e2-ea6626598e7e tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:52.242775 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-203d794e-e4ac-496b-a8e2-ea6626598e7e tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:52.243203 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-203d794e-e4ac-496b-a8e2-ea6626598e7e tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:52.279419 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-2b726c19-a850-41e8-b035-a18aba81deb4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 27829 microversion: 2.1 time: 0.233054 Aug 27 01:31:52.284061 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 155/295] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:31:52 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 27829 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:31:52.286807 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-632546fd-c25e-47f0-849f-0d8b11722956 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:52.287530 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-632546fd-c25e-47f0-849f-0d8b11722956 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 6e8afedf-7eb5-446f-a22d-1412c3a11039] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:52.294125 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-632546fd-c25e-47f0-849f-0d8b11722956 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:52.294557 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-632546fd-c25e-47f0-849f-0d8b11722956 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:52.295394 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-632546fd-c25e-47f0-849f-0d8b11722956 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:52.295905 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-632546fd-c25e-47f0-849f-0d8b11722956 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:52.399681 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-203d794e-e4ac-496b-a8e2-ea6626598e7e tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:52.408181 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-203d794e-e4ac-496b-a8e2-ea6626598e7e tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1553 microversion: 2.1 time: 0.177493 Aug 27 01:31:52.408868 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 141/296] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:52 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1553 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:52.451226 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-632546fd-c25e-47f0-849f-0d8b11722956 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:52.459370 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-632546fd-c25e-47f0-849f-0d8b11722956 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039" status: 200 len: 1318 microversion: 2.1 time: 0.176723 Aug 27 01:31:52.460034 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 156/297] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:52 2021] GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:53.056624 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-56c7191b-f998-4050-bd0f-87aa7f73a9dd tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:53.057566 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-56c7191b-f998-4050-bd0f-87aa7f73a9dd tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:53.064134 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-56c7191b-f998-4050-bd0f-87aa7f73a9dd tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:53.064580 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-56c7191b-f998-4050-bd0f-87aa7f73a9dd tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:53.065400 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-56c7191b-f998-4050-bd0f-87aa7f73a9dd tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:53.065865 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-56c7191b-f998-4050-bd0f-87aa7f73a9dd tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:53.223121 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-56c7191b-f998-4050-bd0f-87aa7f73a9dd tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 27741 microversion: 2.20 time: 0.171955 Aug 27 01:31:53.223760 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 142/298] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:31:53 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 27741 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:31:53.247082 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-8a519f63-c620-4bd8-8010-0a773e12428b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:53.247833 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-8a519f63-c620-4bd8-8010-0a773e12428b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:53.254561 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8a519f63-c620-4bd8-8010-0a773e12428b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:53.255009 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8a519f63-c620-4bd8-8010-0a773e12428b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:53.255771 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8a519f63-c620-4bd8-8010-0a773e12428b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:53.256208 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8a519f63-c620-4bd8-8010-0a773e12428b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:53.290236 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-f250960c-c005-450e-a0c7-21eb0c817706 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:53.291670 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-f250960c-c005-450e-a0c7-21eb0c817706 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:53.311730 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f250960c-c005-450e-a0c7-21eb0c817706 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:53.312980 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f250960c-c005-450e-a0c7-21eb0c817706 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:53.313914 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f250960c-c005-450e-a0c7-21eb0c817706 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:53.314351 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f250960c-c005-450e-a0c7-21eb0c817706 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:53.403661 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-8a519f63-c620-4bd8-8010-0a773e12428b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:53.413767 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-8a519f63-c620-4bd8-8010-0a773e12428b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.169735 Aug 27 01:31:53.414339 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 157/299] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:53 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:53.427571 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d8150208-4689-4a3a-8d44-faf39423a28b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:53.428177 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d8150208-4689-4a3a-8d44-faf39423a28b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:53.434213 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d8150208-4689-4a3a-8d44-faf39423a28b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:53.434658 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d8150208-4689-4a3a-8d44-faf39423a28b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:53.435416 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d8150208-4689-4a3a-8d44-faf39423a28b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:53.435844 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d8150208-4689-4a3a-8d44-faf39423a28b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:53.478907 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-f250960c-c005-450e-a0c7-21eb0c817706 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 27942 microversion: 2.1 time: 0.193558 Aug 27 01:31:53.480421 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 143/300] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:31:53 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 27942 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:31:53.484803 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-413341de-2435-46cd-8199-a61b6e5905f3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:53.485523 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-413341de-2435-46cd-8199-a61b6e5905f3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 6e8afedf-7eb5-446f-a22d-1412c3a11039] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:53.491999 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-413341de-2435-46cd-8199-a61b6e5905f3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:53.492444 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-413341de-2435-46cd-8199-a61b6e5905f3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:53.493247 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-413341de-2435-46cd-8199-a61b6e5905f3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:53.493677 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-413341de-2435-46cd-8199-a61b6e5905f3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:53.557993 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d8150208-4689-4a3a-8d44-faf39423a28b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:53.566778 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d8150208-4689-4a3a-8d44-faf39423a28b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1553 microversion: 2.1 time: 0.142838 Aug 27 01:31:53.567342 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 158/301] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:53 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1553 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:53.614330 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-413341de-2435-46cd-8199-a61b6e5905f3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:53.621883 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-413341de-2435-46cd-8199-a61b6e5905f3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039" status: 200 len: 1318 microversion: 2.1 time: 0.141186 Aug 27 01:31:53.622537 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 144/302] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:53 2021] GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039 => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:54.234702 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b265a85e-e33a-47a9-a004-101fa19aae36 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:54.235657 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b265a85e-e33a-47a9-a004-101fa19aae36 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:54.242727 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b265a85e-e33a-47a9-a004-101fa19aae36 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:54.243280 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b265a85e-e33a-47a9-a004-101fa19aae36 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:54.244324 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b265a85e-e33a-47a9-a004-101fa19aae36 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:54.244822 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b265a85e-e33a-47a9-a004-101fa19aae36 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:54.386859 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b265a85e-e33a-47a9-a004-101fa19aae36 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 27876 microversion: 2.20 time: 0.155823 Aug 27 01:31:54.392867 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 159/303] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:31:54 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 27876 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:31:54.431281 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-3250dc8d-2d2c-4399-b246-eeda7d97afab tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:54.431912 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-3250dc8d-2d2c-4399-b246-eeda7d97afab tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:54.438354 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3250dc8d-2d2c-4399-b246-eeda7d97afab tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:54.438733 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3250dc8d-2d2c-4399-b246-eeda7d97afab tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:54.439503 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3250dc8d-2d2c-4399-b246-eeda7d97afab tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:54.439935 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3250dc8d-2d2c-4399-b246-eeda7d97afab tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:54.493322 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-2cdac423-b318-46ce-8516-a37351d5b51f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:54.494280 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-2cdac423-b318-46ce-8516-a37351d5b51f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:54.501663 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2cdac423-b318-46ce-8516-a37351d5b51f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:54.502408 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2cdac423-b318-46ce-8516-a37351d5b51f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:54.503327 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2cdac423-b318-46ce-8516-a37351d5b51f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:54.503752 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2cdac423-b318-46ce-8516-a37351d5b51f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:54.594355 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-3250dc8d-2d2c-4399-b246-eeda7d97afab tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:54.602224 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-3250dc8d-2d2c-4399-b246-eeda7d97afab tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.174796 Aug 27 01:31:54.602845 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 145/304] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:54 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:54.607361 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-db934264-6c5d-4c07-b80f-5f566f8322df tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:54.608060 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-db934264-6c5d-4c07-b80f-5f566f8322df tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:54.613823 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-db934264-6c5d-4c07-b80f-5f566f8322df tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:54.614338 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-db934264-6c5d-4c07-b80f-5f566f8322df tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:54.615099 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-db934264-6c5d-4c07-b80f-5f566f8322df tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:54.615542 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-db934264-6c5d-4c07-b80f-5f566f8322df tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:54.658886 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-2cdac423-b318-46ce-8516-a37351d5b51f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 28051 microversion: 2.1 time: 0.169565 Aug 27 01:31:54.659575 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 160/305] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:31:54 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 28051 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:31:54.666867 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-651df627-4723-4f12-a62b-31764ead3e84 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:54.667811 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-651df627-4723-4f12-a62b-31764ead3e84 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 6e8afedf-7eb5-446f-a22d-1412c3a11039] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:54.689438 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-651df627-4723-4f12-a62b-31764ead3e84 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:54.690219 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-651df627-4723-4f12-a62b-31764ead3e84 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:54.691688 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-651df627-4723-4f12-a62b-31764ead3e84 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:54.692268 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-651df627-4723-4f12-a62b-31764ead3e84 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:54.884404 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-651df627-4723-4f12-a62b-31764ead3e84 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:54.892437 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-651df627-4723-4f12-a62b-31764ead3e84 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039" status: 200 len: 1318 microversion: 2.1 time: 0.231510 Aug 27 01:31:54.893230 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 161/306] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:54 2021] GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:54.931674 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-db934264-6c5d-4c07-b80f-5f566f8322df tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:54.940953 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-db934264-6c5d-4c07-b80f-5f566f8322df tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1553 microversion: 2.1 time: 0.336221 Aug 27 01:31:54.940953 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 146/307] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:54 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1553 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:55.400906 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-cbab8c96-a519-449b-9a2c-d43d7b61eede tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:55.403320 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-cbab8c96-a519-449b-9a2c-d43d7b61eede tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:55.408314 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-cbab8c96-a519-449b-9a2c-d43d7b61eede tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:55.408753 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-cbab8c96-a519-449b-9a2c-d43d7b61eede tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:55.409713 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-cbab8c96-a519-449b-9a2c-d43d7b61eede tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:55.410151 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-cbab8c96-a519-449b-9a2c-d43d7b61eede tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:55.599710 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-cbab8c96-a519-449b-9a2c-d43d7b61eede tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 28095 microversion: 2.20 time: 0.202425 Aug 27 01:31:55.600488 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 162/308] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:31:55 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 28095 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:31:55.619478 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-79152e51-a0f6-4ec8-beb9-cece0aa6443f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:55.620079 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-79152e51-a0f6-4ec8-beb9-cece0aa6443f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:55.626866 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-79152e51-a0f6-4ec8-beb9-cece0aa6443f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:55.627495 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-79152e51-a0f6-4ec8-beb9-cece0aa6443f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:55.628463 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-79152e51-a0f6-4ec8-beb9-cece0aa6443f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:55.628924 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-79152e51-a0f6-4ec8-beb9-cece0aa6443f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:55.677930 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-35c2a7aa-1970-4092-8e4f-abc89df73492 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:55.680341 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-35c2a7aa-1970-4092-8e4f-abc89df73492 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:55.688826 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-35c2a7aa-1970-4092-8e4f-abc89df73492 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:55.690372 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-35c2a7aa-1970-4092-8e4f-abc89df73492 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:55.691730 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-35c2a7aa-1970-4092-8e4f-abc89df73492 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:55.692940 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-35c2a7aa-1970-4092-8e4f-abc89df73492 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:55.762782 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-79152e51-a0f6-4ec8-beb9-cece0aa6443f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:55.777248 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-79152e51-a0f6-4ec8-beb9-cece0aa6443f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.160116 Aug 27 01:31:55.779490 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 147/309] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:55 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:55.909800 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-de53afce-4a2f-448e-9db3-b5fd241212ff tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:55.910468 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-de53afce-4a2f-448e-9db3-b5fd241212ff tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 6e8afedf-7eb5-446f-a22d-1412c3a11039] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:55.916118 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-de53afce-4a2f-448e-9db3-b5fd241212ff tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:55.916563 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-de53afce-4a2f-448e-9db3-b5fd241212ff tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:55.917347 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-de53afce-4a2f-448e-9db3-b5fd241212ff tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:55.917774 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-de53afce-4a2f-448e-9db3-b5fd241212ff tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:55.944568 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-35c2a7aa-1970-4092-8e4f-abc89df73492 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 28195 microversion: 2.1 time: 0.276093 Aug 27 01:31:55.945834 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 163/310] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:31:55 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 28195 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:31:55.957239 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-2e234b5f-f544-4241-8bf9-bec588bcadbf tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:55.958156 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-2e234b5f-f544-4241-8bf9-bec588bcadbf tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:55.968695 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2e234b5f-f544-4241-8bf9-bec588bcadbf tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:55.969741 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2e234b5f-f544-4241-8bf9-bec588bcadbf tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:55.970515 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2e234b5f-f544-4241-8bf9-bec588bcadbf tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:55.970949 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2e234b5f-f544-4241-8bf9-bec588bcadbf tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:56.069961 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-de53afce-4a2f-448e-9db3-b5fd241212ff tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:56.078738 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-de53afce-4a2f-448e-9db3-b5fd241212ff tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039" status: 200 len: 1318 microversion: 2.1 time: 0.172994 Aug 27 01:31:56.080493 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 148/311] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:55 2021] GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:56.229301 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-2e234b5f-f544-4241-8bf9-bec588bcadbf tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:56.239320 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-2e234b5f-f544-4241-8bf9-bec588bcadbf tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1553 microversion: 2.1 time: 0.284490 Aug 27 01:31:56.239320 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 164/312] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:55 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1553 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:56.545629 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-18630f46-0eab-40fb-aa99-8619ba7c71ad req-0a6cf930-9800-45ee-880a-7652a17c46be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e8afedf-7eb5-446f-a22d-1412c3a11039", "name": "network-vif-plugged", "status": "completed", "tag": "cd19f281-5f24-4728-b09e-57bb575f8a48"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:56.547793 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:31:56.547793 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:31:56.555915 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-18630f46-0eab-40fb-aa99-8619ba7c71ad req-0a6cf930-9800-45ee-880a-7652a17c46be service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:56.556361 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-18630f46-0eab-40fb-aa99-8619ba7c71ad req-0a6cf930-9800-45ee-880a-7652a17c46be service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:56.567382 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-18630f46-0eab-40fb-aa99-8619ba7c71ad req-0a6cf930-9800-45ee-880a-7652a17c46be service nova] Creating event network-vif-plugged:cd19f281-5f24-4728-b09e-57bb575f8a48 for instance 6e8afedf-7eb5-446f-a22d-1412c3a11039 on hv-cinder-75916 Aug 27 01:31:56.572105 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-18630f46-0eab-40fb-aa99-8619ba7c71ad req-0a6cf930-9800-45ee-880a-7652a17c46be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030130 Aug 27 01:31:56.572689 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 149/313] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:31:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:31:56.614741 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-3627275b-2215-49f7-8cc1-dd711e839fc7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:56.616569 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-3627275b-2215-49f7-8cc1-dd711e839fc7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:56.624677 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3627275b-2215-49f7-8cc1-dd711e839fc7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:56.626290 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3627275b-2215-49f7-8cc1-dd711e839fc7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:56.627315 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3627275b-2215-49f7-8cc1-dd711e839fc7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:56.628064 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3627275b-2215-49f7-8cc1-dd711e839fc7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:56.718299 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-ab256590-beb9-4dca-8a43-caf17dd926ac req-253d56b6-9e3c-41e4-a680-0704fb8a521d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b401b16-f181-45c2-99c7-73e06eb28974", "name": "network-vif-deleted", "tag": "2f74abdb-9f0c-4344-b541-0b15dc2c35bc"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:56.721325 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:31:56.721325 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:31:56.736026 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-ab256590-beb9-4dca-8a43-caf17dd926ac req-253d56b6-9e3c-41e4-a680-0704fb8a521d service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:56.736576 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-ab256590-beb9-4dca-8a43-caf17dd926ac req-253d56b6-9e3c-41e4-a680-0704fb8a521d service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:56.747468 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-ab256590-beb9-4dca-8a43-caf17dd926ac req-253d56b6-9e3c-41e4-a680-0704fb8a521d service nova] Creating event network-vif-deleted:2f74abdb-9f0c-4344-b541-0b15dc2c35bc for instance 9b401b16-f181-45c2-99c7-73e06eb28974 on hv-cinder-75916 Aug 27 01:31:56.753760 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-ab256590-beb9-4dca-8a43-caf17dd926ac req-253d56b6-9e3c-41e4-a680-0704fb8a521d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050093 Aug 27 01:31:56.755986 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 150/314] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:31:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:31:56.758392 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-3627275b-2215-49f7-8cc1-dd711e839fc7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 28095 microversion: 2.20 time: 0.147722 Aug 27 01:31:56.759011 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 165/315] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:31:56 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 28095 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 01:31:56.799942 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-233b9430-f539-48fc-bdd7-9ad387340fea tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:56.800624 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-233b9430-f539-48fc-bdd7-9ad387340fea tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:56.807121 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-233b9430-f539-48fc-bdd7-9ad387340fea tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:56.807561 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-233b9430-f539-48fc-bdd7-9ad387340fea tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:56.808318 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-233b9430-f539-48fc-bdd7-9ad387340fea tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:56.808928 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-233b9430-f539-48fc-bdd7-9ad387340fea tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:56.958150 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-c9d281dc-8548-42db-884f-c3db38df86fa tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:56.959496 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-c9d281dc-8548-42db-884f-c3db38df86fa tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:56.966732 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c9d281dc-8548-42db-884f-c3db38df86fa tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:56.967251 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c9d281dc-8548-42db-884f-c3db38df86fa tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:56.968095 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c9d281dc-8548-42db-884f-c3db38df86fa tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:56.968604 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c9d281dc-8548-42db-884f-c3db38df86fa tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:56.976611 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-233b9430-f539-48fc-bdd7-9ad387340fea tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:56.985375 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-233b9430-f539-48fc-bdd7-9ad387340fea tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.189524 Aug 27 01:31:56.986488 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 151/316] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:56 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:57.074703 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-c9d281dc-8548-42db-884f-c3db38df86fa tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 28195 microversion: 2.1 time: 0.121188 Aug 27 01:31:57.075650 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 166/317] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:31:56 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 28195 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:31:57.097679 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-a049ccf0-4704-4194-a5d0-15aba3ca7dea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:57.098342 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-a049ccf0-4704-4194-a5d0-15aba3ca7dea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 6e8afedf-7eb5-446f-a22d-1412c3a11039] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:57.104460 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a049ccf0-4704-4194-a5d0-15aba3ca7dea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:57.105022 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a049ccf0-4704-4194-a5d0-15aba3ca7dea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:57.105798 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a049ccf0-4704-4194-a5d0-15aba3ca7dea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:57.106231 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a049ccf0-4704-4194-a5d0-15aba3ca7dea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:57.248550 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-a049ccf0-4704-4194-a5d0-15aba3ca7dea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:57.255742 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-c6dc8db3-69dd-42b4-b29c-9cb6daf49da5 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:57.256904 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-c6dc8db3-69dd-42b4-b29c-9cb6daf49da5 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:57.263307 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-a049ccf0-4704-4194-a5d0-15aba3ca7dea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039" status: 200 len: 1318 microversion: 2.1 time: 0.170236 Aug 27 01:31:57.263885 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 152/318] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:57 2021] GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:57.264951 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c6dc8db3-69dd-42b4-b29c-9cb6daf49da5 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:57.265582 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c6dc8db3-69dd-42b4-b29c-9cb6daf49da5 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:57.266646 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c6dc8db3-69dd-42b4-b29c-9cb6daf49da5 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:57.267502 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c6dc8db3-69dd-42b4-b29c-9cb6daf49da5 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:57.339380 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-c6dc8db3-69dd-42b4-b29c-9cb6daf49da5 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:57.349041 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-c6dc8db3-69dd-42b4-b29c-9cb6daf49da5 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1345 microversion: 2.1 time: 0.097926 Aug 27 01:31:57.349459 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 167/319] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:57 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1345 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:57.769855 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-92623c4a-2085-448f-a2b3-2b8cb42bc00e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:57.770845 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-92623c4a-2085-448f-a2b3-2b8cb42bc00e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:57.776677 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-92623c4a-2085-448f-a2b3-2b8cb42bc00e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:57.777145 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-92623c4a-2085-448f-a2b3-2b8cb42bc00e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:57.777918 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-92623c4a-2085-448f-a2b3-2b8cb42bc00e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:57.778339 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-92623c4a-2085-448f-a2b3-2b8cb42bc00e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:57.900740 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-92623c4a-2085-448f-a2b3-2b8cb42bc00e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 28095 microversion: 2.20 time: 0.134990 Aug 27 01:31:57.901491 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 153/320] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:31:57 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 28095 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:31:58.007292 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-fda7762f-f637-452c-8648-983e82fdd94c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:58.019933 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-fda7762f-f637-452c-8648-983e82fdd94c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:58.043267 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fda7762f-f637-452c-8648-983e82fdd94c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:58.043796 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fda7762f-f637-452c-8648-983e82fdd94c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:58.044510 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fda7762f-f637-452c-8648-983e82fdd94c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:58.044976 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fda7762f-f637-452c-8648-983e82fdd94c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:58.090212 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-f64e7cc5-a1ba-4fbb-aae7-498876c5050c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:58.091216 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-f64e7cc5-a1ba-4fbb-aae7-498876c5050c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:58.098547 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f64e7cc5-a1ba-4fbb-aae7-498876c5050c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:58.098998 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f64e7cc5-a1ba-4fbb-aae7-498876c5050c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:58.099783 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f64e7cc5-a1ba-4fbb-aae7-498876c5050c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:58.100222 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f64e7cc5-a1ba-4fbb-aae7-498876c5050c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:58.216739 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-f64e7cc5-a1ba-4fbb-aae7-498876c5050c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 28195 microversion: 2.1 time: 0.130327 Aug 27 01:31:58.218335 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-fda7762f-f637-452c-8648-983e82fdd94c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:58.225904 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 154/321] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:31:58 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 28195 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:31:58.233414 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-fda7762f-f637-452c-8648-983e82fdd94c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.233578 Aug 27 01:31:58.234392 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 168/322] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:57 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:58.280130 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-035a5a6e-9a8e-43d5-ba12-da111b314c5c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:58.280957 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-035a5a6e-9a8e-43d5-ba12-da111b314c5c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 6e8afedf-7eb5-446f-a22d-1412c3a11039] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:58.291049 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-035a5a6e-9a8e-43d5-ba12-da111b314c5c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:58.291711 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-035a5a6e-9a8e-43d5-ba12-da111b314c5c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:58.292672 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-035a5a6e-9a8e-43d5-ba12-da111b314c5c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:58.293308 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-035a5a6e-9a8e-43d5-ba12-da111b314c5c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:58.366525 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-24da1ba2-9d15-409e-8ff0-f68e20143c2b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:58.367707 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-24da1ba2-9d15-409e-8ff0-f68e20143c2b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:58.374736 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-24da1ba2-9d15-409e-8ff0-f68e20143c2b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:58.375358 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-24da1ba2-9d15-409e-8ff0-f68e20143c2b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:58.376847 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-24da1ba2-9d15-409e-8ff0-f68e20143c2b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:58.377373 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-24da1ba2-9d15-409e-8ff0-f68e20143c2b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:58.419375 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-24da1ba2-9d15-409e-8ff0-f68e20143c2b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:58.420152 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-24da1ba2-9d15-409e-8ff0-f68e20143c2b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:58.421908 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.objects.instance [None req-24da1ba2-9d15-409e-8ff0-f68e20143c2b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lazy-loading 'fault' on Instance uuid 9b401b16-f181-45c2-99c7-73e06eb28974 {{(pid=108755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:31:58.503253 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-24da1ba2-9d15-409e-8ff0-f68e20143c2b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63916350d84642b0b2606341d71651f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f4319d61634014a030eb7b9b741e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:58.511669 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-24da1ba2-9d15-409e-8ff0-f68e20143c2b tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 200 len: 1350 microversion: 2.1 time: 0.149028 Aug 27 01:31:58.512242 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 169/323] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:58 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:58.690224 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-035a5a6e-9a8e-43d5-ba12-da111b314c5c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:58.698143 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-035a5a6e-9a8e-43d5-ba12-da111b314c5c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039" status: 200 len: 1318 microversion: 2.1 time: 0.422378 Aug 27 01:31:58.698705 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 155/324] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:58 2021] GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039 => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:58.913108 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-ac0a2220-69f7-4ef8-a157-f9c4667c5ef9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:58.914072 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-ac0a2220-69f7-4ef8-a157-f9c4667c5ef9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:58.919811 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ac0a2220-69f7-4ef8-a157-f9c4667c5ef9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:58.920248 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ac0a2220-69f7-4ef8-a157-f9c4667c5ef9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:58.921030 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ac0a2220-69f7-4ef8-a157-f9c4667c5ef9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:58.921453 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ac0a2220-69f7-4ef8-a157-f9c4667c5ef9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:59.041505 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-ac0a2220-69f7-4ef8-a157-f9c4667c5ef9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 28095 microversion: 2.20 time: 0.131964 Aug 27 01:31:59.042227 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 170/325] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:31:58 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 28095 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:31:59.232665 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-4bf56782-ccae-48b9-9b0b-b9c60dd1bb23 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:59.233683 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-4bf56782-ccae-48b9-9b0b-b9c60dd1bb23 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:59.240047 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4bf56782-ccae-48b9-9b0b-b9c60dd1bb23 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:59.240552 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4bf56782-ccae-48b9-9b0b-b9c60dd1bb23 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:59.241406 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4bf56782-ccae-48b9-9b0b-b9c60dd1bb23 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:59.241901 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4bf56782-ccae-48b9-9b0b-b9c60dd1bb23 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:59.252352 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-dd0b1f3f-e8f0-4039-823d-d26de3e4c33a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:59.253086 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-dd0b1f3f-e8f0-4039-823d-d26de3e4c33a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:59.263598 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-dd0b1f3f-e8f0-4039-823d-d26de3e4c33a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:59.264225 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-dd0b1f3f-e8f0-4039-823d-d26de3e4c33a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:59.264987 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-dd0b1f3f-e8f0-4039-823d-d26de3e4c33a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:59.265600 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-dd0b1f3f-e8f0-4039-823d-d26de3e4c33a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:59.362545 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-4bf56782-ccae-48b9-9b0b-b9c60dd1bb23 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 28195 microversion: 2.1 time: 0.133326 Aug 27 01:31:59.363960 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 156/326] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:31:59 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 28195 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:31:59.398487 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-dd0b1f3f-e8f0-4039-823d-d26de3e4c33a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:59.406797 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-dd0b1f3f-e8f0-4039-823d-d26de3e4c33a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.158902 Aug 27 01:31:59.416797 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 171/327] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:59 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:31:59.529322 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-def66557-916e-4401-af9c-656728767911 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:59.530086 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-def66557-916e-4401-af9c-656728767911 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:59.536812 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-def66557-916e-4401-af9c-656728767911 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:59.537357 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-def66557-916e-4401-af9c-656728767911 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:59.538186 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-def66557-916e-4401-af9c-656728767911 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:59.538636 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-def66557-916e-4401-af9c-656728767911 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:59.552273 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.wsgi [None req-def66557-916e-4401-af9c-656728767911 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] HTTP exception thrown: Instance 9b401b16-f181-45c2-99c7-73e06eb28974 could not be found. Aug 27 01:31:59.552859 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-def66557-916e-4401-af9c-656728767911 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Returning 404 to user: Instance 9b401b16-f181-45c2-99c7-73e06eb28974 could not be found. {{(pid=108756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:31:59.553667 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-def66557-916e-4401-af9c-656728767911 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 404 len: 111 microversion: 2.1 time: 0.028330 Aug 27 01:31:59.554444 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 157/328] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:59 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:31:59.666764 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b89b79a5-09e8-4b76-833b-4604a8bf9c90 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:59.667715 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b89b79a5-09e8-4b76-833b-4604a8bf9c90 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:59.673867 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b89b79a5-09e8-4b76-833b-4604a8bf9c90 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:59.674314 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b89b79a5-09e8-4b76-833b-4604a8bf9c90 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:59.675086 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b89b79a5-09e8-4b76-833b-4604a8bf9c90 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:59.675525 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b89b79a5-09e8-4b76-833b-4604a8bf9c90 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:59.715098 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-d7c1b347-688f-4d14-a1dd-727460d28692 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:31:59.715797 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-d7c1b347-688f-4d14-a1dd-727460d28692 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 6e8afedf-7eb5-446f-a22d-1412c3a11039] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:59.722561 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d7c1b347-688f-4d14-a1dd-727460d28692 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:59.723006 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d7c1b347-688f-4d14-a1dd-727460d28692 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:59.723824 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d7c1b347-688f-4d14-a1dd-727460d28692 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:59.724261 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d7c1b347-688f-4d14-a1dd-727460d28692 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:59.836134 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.wsgi [None req-b89b79a5-09e8-4b76-833b-4604a8bf9c90 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] HTTP exception thrown: Instance 9b401b16-f181-45c2-99c7-73e06eb28974 could not be found. Aug 27 01:31:59.836735 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b89b79a5-09e8-4b76-833b-4604a8bf9c90 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Returning 404 to user: Instance 9b401b16-f181-45c2-99c7-73e06eb28974 could not be found. {{(pid=108755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:31:59.837791 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b89b79a5-09e8-4b76-833b-4604a8bf9c90 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.174630 Aug 27 01:31:59.838334 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 172/329] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:31:59 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974/os-volume_attachments => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:31:59.860554 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-d7c1b347-688f-4d14-a1dd-727460d28692 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:31:59.868359 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-d7c1b347-688f-4d14-a1dd-727460d28692 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039" status: 200 len: 1509 microversion: 2.1 time: 0.157350 Aug 27 01:31:59.868936 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 158/330] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:31:59 2021] GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:31:59.885633 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-a8a1f75c-11d2-496d-830c-7da7d71d79ae tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aefa404e-db71-404c-b703-fb601d61ae51"}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:31:59.886784 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-a8a1f75c-11d2-496d-830c-7da7d71d79ae tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 6e8afedf-7eb5-446f-a22d-1412c3a11039] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:31:59.893439 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a8a1f75c-11d2-496d-830c-7da7d71d79ae tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:59.893889 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a8a1f75c-11d2-496d-830c-7da7d71d79ae tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:31:59.894719 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a8a1f75c-11d2-496d-830c-7da7d71d79ae tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:31:59.895654 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a8a1f75c-11d2-496d-830c-7da7d71d79ae tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:00.052679 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-1c21e4ef-e756-40f7-94d9-f8fa313c5a83 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:00.053613 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-1c21e4ef-e756-40f7-94d9-f8fa313c5a83 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:00.059681 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1c21e4ef-e756-40f7-94d9-f8fa313c5a83 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:00.060114 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1c21e4ef-e756-40f7-94d9-f8fa313c5a83 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:00.060899 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1c21e4ef-e756-40f7-94d9-f8fa313c5a83 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:00.061334 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1c21e4ef-e756-40f7-94d9-f8fa313c5a83 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:00.161059 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.wsgi [None req-a8a1f75c-11d2-496d-830c-7da7d71d79ae tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] HTTP exception thrown: Invalid volume: volume aefa404e-db71-404c-b703-fb601d61ae51 is already attached to instances: f70206d1-bfb4-4b0a-9215-72f8e06a7c66 Aug 27 01:32:00.161661 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-a8a1f75c-11d2-496d-830c-7da7d71d79ae tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Returning 400 to user: Invalid volume: volume aefa404e-db71-404c-b703-fb601d61ae51 is already attached to instances: f70206d1-bfb4-4b0a-9215-72f8e06a7c66 {{(pid=108755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:32:00.162483 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-a8a1f75c-11d2-496d-830c-7da7d71d79ae tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "POST /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.280661 Aug 27 01:32:00.163149 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 173/331] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Aug 27 01:31:59 2021] POST /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039/os-volume_attachments => generated 174 bytes in 282 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 01:32:00.196601 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-1c21e4ef-e756-40f7-94d9-f8fa313c5a83 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 28120 microversion: 2.20 time: 0.147208 Aug 27 01:32:00.200754 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 159/332] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:32:00 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 28120 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 01:32:00.335282 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b3107cac-3c7b-4d15-b53b-434bbe283c05 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:00.335783 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b3107cac-3c7b-4d15-b53b-434bbe283c05 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:00.341911 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b3107cac-3c7b-4d15-b53b-434bbe283c05 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:00.342359 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b3107cac-3c7b-4d15-b53b-434bbe283c05 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:00.343139 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b3107cac-3c7b-4d15-b53b-434bbe283c05 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:00.343577 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b3107cac-3c7b-4d15-b53b-434bbe283c05 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:00.374793 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-319d9951-f248-4678-89ce-20a116a74184 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:00.377253 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-319d9951-f248-4678-89ce-20a116a74184 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:00.383629 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-319d9951-f248-4678-89ce-20a116a74184 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:00.384073 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-319d9951-f248-4678-89ce-20a116a74184 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:00.384871 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-319d9951-f248-4678-89ce-20a116a74184 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:00.385342 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-319d9951-f248-4678-89ce-20a116a74184 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:00.475751 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.objects.instance [None req-b3107cac-3c7b-4d15-b53b-434bbe283c05 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lazy-loading 'services' on Instance uuid f70206d1-bfb4-4b0a-9215-72f8e06a7c66 {{(pid=108755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:32:00.503317 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-319d9951-f248-4678-89ce-20a116a74184 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 28437 microversion: 2.1 time: 0.132414 Aug 27 01:32:00.507369 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 160/333] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:32:00 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 28437 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:32:00.509223 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-db276058-eb11-42e8-8698-cb57289d1d7c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1217653276", "imageRef": "6660bea6-dee9-43b4-95ef-29b53e1a2b28", "flavorRef": "452", "networks": [{"uuid": "6798e174-42c2-4b00-8cdd-a750c850a0c6"}]}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:00.565796 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.network.neutron [None req-db276058-eb11-42e8-8698-cb57289d1d7c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] validate_networks() for [('6798e174-42c2-4b00-8cdd-a750c850a0c6', None, None, None, None, None)] {{(pid=108756) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 01:32:00.760819 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b3107cac-3c7b-4d15-b53b-434bbe283c05 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66/os-volume_attachments/aefa404e-db71-404c-b703-fb601d61ae51" status: 202 len: 0 microversion: 2.1 time: 0.430277 Aug 27 01:32:00.761522 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 174/334] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Aug 27 01:32:00 2021] DELETE /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66/os-volume_attachments/aefa404e-db71-404c-b703-fb601d61ae51 => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:32:00.767493 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-2247bf39-7a4e-49ec-91ec-b22867337d7d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:00.777063 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-2247bf39-7a4e-49ec-91ec-b22867337d7d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:00.784947 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2247bf39-7a4e-49ec-91ec-b22867337d7d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:00.785514 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2247bf39-7a4e-49ec-91ec-b22867337d7d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:00.786289 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2247bf39-7a4e-49ec-91ec-b22867337d7d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:00.786811 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2247bf39-7a4e-49ec-91ec-b22867337d7d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:00.924821 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-2247bf39-7a4e-49ec-91ec-b22867337d7d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:00.933719 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-2247bf39-7a4e-49ec-91ec-b22867337d7d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.171057 Aug 27 01:32:00.949917 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 175/335] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:00 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:00.953159 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-db276058-eb11-42e8-8698-cb57289d1d7c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Flavor limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 01:32:00.953595 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-db276058-eb11-42e8-8698-cb57289d1d7c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Image limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 01:32:00.954300 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-db276058-eb11-42e8-8698-cb57289d1d7c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Flavor pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 01:32:00.954709 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-db276058-eb11-42e8-8698-cb57289d1d7c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Image pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 01:32:00.955150 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-db276058-eb11-42e8-8698-cb57289d1d7c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 01:32:00.957161 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b382489a-85a2-4650-8c00-df235a6ae809 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:00.959288 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b382489a-85a2-4650-8c00-df235a6ae809 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:00.966332 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b382489a-85a2-4650-8c00-df235a6ae809 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:00.971218 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b382489a-85a2-4650-8c00-df235a6ae809 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:00.971218 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b382489a-85a2-4650-8c00-df235a6ae809 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:00.971218 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b382489a-85a2-4650-8c00-df235a6ae809 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:00.973663 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-db276058-eb11-42e8-8698-cb57289d1d7c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:00.974175 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-db276058-eb11-42e8-8698-cb57289d1d7c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:00.975018 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-db276058-eb11-42e8-8698-cb57289d1d7c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:00.976479 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-db276058-eb11-42e8-8698-cb57289d1d7c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:00.993956 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-db276058-eb11-42e8-8698-cb57289d1d7c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Getting quotas for project b0342a0d1e3b49c29852c11d8aeadb6f. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:32:00.998223 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-db276058-eb11-42e8-8698-cb57289d1d7c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Getting quotas for user 76bcad9416ea4ffd966b9827246ef936 and project b0342a0d1e3b49c29852c11d8aeadb6f. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:32:01.004955 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b382489a-85a2-4650-8c00-df235a6ae809 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053150 Aug 27 01:32:01.005441 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 176/336] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:32:00 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:32:01.011152 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-db276058-eb11-42e8-8698-cb57289d1d7c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Going to run 1 instances... {{(pid=108756) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 01:32:01.013564 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-db276058-eb11-42e8-8698-cb57289d1d7c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6660bea6-dee9-43b4-95ef-29b53e1a2b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 01:32:01.106650 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-db276058-eb11-42e8-8698-cb57289d1d7c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601155 Aug 27 01:32:01.107211 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 161/337] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Aug 27 01:32:00 2021] POST /compute/v2.1/servers => generated 380 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 01:32:01.117832 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-8021fb00-7b01-49db-973a-2da33de4de23 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:01.118433 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-8021fb00-7b01-49db-973a-2da33de4de23 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:01.172561 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-8021fb00-7b01-49db-973a-2da33de4de23 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:01.179344 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-8021fb00-7b01-49db-973a-2da33de4de23 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1219 microversion: 2.1 time: 0.064764 Aug 27 01:32:01.179822 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 177/338] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:01 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:01.207997 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c0351c72-b6fb-4346-a1db-c60acf845168 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:01.209028 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c0351c72-b6fb-4346-a1db-c60acf845168 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:01.215693 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c0351c72-b6fb-4346-a1db-c60acf845168 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:01.216210 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c0351c72-b6fb-4346-a1db-c60acf845168 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:01.217150 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c0351c72-b6fb-4346-a1db-c60acf845168 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:01.217667 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c0351c72-b6fb-4346-a1db-c60acf845168 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:01.272249 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d4d07f23-cde6-43e1-a434-0eed2a48bf38 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:01.272733 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d4d07f23-cde6-43e1-a434-0eed2a48bf38 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:01.278575 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d4d07f23-cde6-43e1-a434-0eed2a48bf38 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:01.279019 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d4d07f23-cde6-43e1-a434-0eed2a48bf38 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:01.279767 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d4d07f23-cde6-43e1-a434-0eed2a48bf38 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:01.280193 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d4d07f23-cde6-43e1-a434-0eed2a48bf38 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:01.293353 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.wsgi [None req-d4d07f23-cde6-43e1-a434-0eed2a48bf38 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] HTTP exception thrown: Instance 9b401b16-f181-45c2-99c7-73e06eb28974 could not be found. Aug 27 01:32:01.293924 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d4d07f23-cde6-43e1-a434-0eed2a48bf38 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Returning 404 to user: Instance 9b401b16-f181-45c2-99c7-73e06eb28974 could not be found. {{(pid=108755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:32:01.294727 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d4d07f23-cde6-43e1-a434-0eed2a48bf38 tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 404 len: 111 microversion: 2.1 time: 0.026077 Aug 27 01:32:01.295236 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 178/339] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Aug 27 01:32:01 2021] DELETE /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 01:32:01.303213 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-694a9ada-c24a-4501-a609-b3996d5507cc tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:01.303816 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-694a9ada-c24a-4501-a609-b3996d5507cc tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] [instance: 9b401b16-f181-45c2-99c7-73e06eb28974] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:01.309621 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-694a9ada-c24a-4501-a609-b3996d5507cc tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:01.310066 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-694a9ada-c24a-4501-a609-b3996d5507cc tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:01.310815 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-694a9ada-c24a-4501-a609-b3996d5507cc tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:01.311247 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-694a9ada-c24a-4501-a609-b3996d5507cc tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:01.324330 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.wsgi [None req-694a9ada-c24a-4501-a609-b3996d5507cc tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] HTTP exception thrown: Instance 9b401b16-f181-45c2-99c7-73e06eb28974 could not be found. Aug 27 01:32:01.324924 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-694a9ada-c24a-4501-a609-b3996d5507cc tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] Returning 404 to user: Instance 9b401b16-f181-45c2-99c7-73e06eb28974 could not be found. {{(pid=108755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:32:01.325735 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-694a9ada-c24a-4501-a609-b3996d5507cc tempest-DeleteServersTestJSON-1201246384 tempest-DeleteServersTestJSON-1201246384-project] 10.222.0.25 "GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974" status: 404 len: 111 microversion: 2.1 time: 0.025949 Aug 27 01:32:01.326220 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 179/340] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:01 2021] GET /compute/v2.1/servers/9b401b16-f181-45c2-99c7-73e06eb28974 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 01:32:01.367798 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c0351c72-b6fb-4346-a1db-c60acf845168 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 28384 microversion: 2.20 time: 0.163909 Aug 27 01:32:01.369814 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 162/341] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:32:01 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 28384 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:32:01.516224 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d643a2f1-df38-4450-afe9-86689b741425 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:01.517125 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d643a2f1-df38-4450-afe9-86689b741425 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:01.524273 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d643a2f1-df38-4450-afe9-86689b741425 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:01.524674 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d643a2f1-df38-4450-afe9-86689b741425 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:01.525532 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d643a2f1-df38-4450-afe9-86689b741425 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:01.525992 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d643a2f1-df38-4450-afe9-86689b741425 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:01.660447 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d643a2f1-df38-4450-afe9-86689b741425 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 28483 microversion: 2.1 time: 0.149229 Aug 27 01:32:01.661986 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 180/342] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:32:01 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 28483 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:32:01.955835 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-9b321d00-a5bd-4b7f-b6f2-b49ee4a89ce9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:01.956517 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-9b321d00-a5bd-4b7f-b6f2-b49ee4a89ce9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:01.963132 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9b321d00-a5bd-4b7f-b6f2-b49ee4a89ce9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:01.963578 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9b321d00-a5bd-4b7f-b6f2-b49ee4a89ce9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:01.964389 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9b321d00-a5bd-4b7f-b6f2-b49ee4a89ce9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:01.964944 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9b321d00-a5bd-4b7f-b6f2-b49ee4a89ce9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:02.017738 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-24b0482f-3e34-42c6-9053-4ee80494fd07 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:02.022667 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-24b0482f-3e34-42c6-9053-4ee80494fd07 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:02.027235 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-24b0482f-3e34-42c6-9053-4ee80494fd07 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:02.027837 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-24b0482f-3e34-42c6-9053-4ee80494fd07 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:02.028563 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-24b0482f-3e34-42c6-9053-4ee80494fd07 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:02.029019 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-24b0482f-3e34-42c6-9053-4ee80494fd07 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:02.061433 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-24b0482f-3e34-42c6-9053-4ee80494fd07 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049228 Aug 27 01:32:02.062668 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 181/343] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:32:02 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:32:02.117714 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-9b321d00-a5bd-4b7f-b6f2-b49ee4a89ce9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:02.125277 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-9b321d00-a5bd-4b7f-b6f2-b49ee4a89ce9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.173421 Aug 27 01:32:02.126360 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 163/344] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:01 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:02.200066 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b3f4adef-6bf4-437b-83a9-15779ab88226 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:02.201294 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b3f4adef-6bf4-437b-83a9-15779ab88226 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:02.209107 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b3f4adef-6bf4-437b-83a9-15779ab88226 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:02.209865 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b3f4adef-6bf4-437b-83a9-15779ab88226 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:02.210859 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b3f4adef-6bf4-437b-83a9-15779ab88226 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:02.211359 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b3f4adef-6bf4-437b-83a9-15779ab88226 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:02.313500 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-b3f4adef-6bf4-437b-83a9-15779ab88226 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:02.322652 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b3f4adef-6bf4-437b-83a9-15779ab88226 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1223 microversion: 2.1 time: 0.129647 Aug 27 01:32:02.323218 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 182/345] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:02 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1223 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:02.386025 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-b071d630-0784-427c-ac28-d10992450d89 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:02.386964 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-b071d630-0784-427c-ac28-d10992450d89 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:02.393763 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b071d630-0784-427c-ac28-d10992450d89 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:02.394450 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b071d630-0784-427c-ac28-d10992450d89 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:02.394932 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b071d630-0784-427c-ac28-d10992450d89 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:02.395590 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b071d630-0784-427c-ac28-d10992450d89 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:02.513448 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-b071d630-0784-427c-ac28-d10992450d89 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 28523 microversion: 2.20 time: 0.131011 Aug 27 01:32:02.518626 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 164/346] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:32:02 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 28523 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:32:02.671283 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-3b9d5968-88b5-4295-8b68-ee4e8e568768 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:02.672444 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-3b9d5968-88b5-4295-8b68-ee4e8e568768 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:02.681376 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3b9d5968-88b5-4295-8b68-ee4e8e568768 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:02.682071 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3b9d5968-88b5-4295-8b68-ee4e8e568768 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:02.683009 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3b9d5968-88b5-4295-8b68-ee4e8e568768 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:02.683439 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3b9d5968-88b5-4295-8b68-ee4e8e568768 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:02.808112 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-3b9d5968-88b5-4295-8b68-ee4e8e568768 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 28651 microversion: 2.1 time: 0.140205 Aug 27 01:32:02.809007 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 183/347] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:32:02 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 28651 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:32:03.075200 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-83ef0953-65ba-470a-94c5-707581f0e9f5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:03.076594 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-83ef0953-65ba-470a-94c5-707581f0e9f5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:03.082947 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-83ef0953-65ba-470a-94c5-707581f0e9f5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:03.083422 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-83ef0953-65ba-470a-94c5-707581f0e9f5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:03.084710 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-83ef0953-65ba-470a-94c5-707581f0e9f5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:03.084937 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-83ef0953-65ba-470a-94c5-707581f0e9f5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:03.154989 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-83ef0953-65ba-470a-94c5-707581f0e9f5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046380 Aug 27 01:32:03.154989 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 165/348] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:32:03 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 01:32:03.156314 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-ee7bb931-8864-435a-9513-aa72cf19d23a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:03.156314 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-ee7bb931-8864-435a-9513-aa72cf19d23a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:03.156314 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ee7bb931-8864-435a-9513-aa72cf19d23a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:03.156314 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ee7bb931-8864-435a-9513-aa72cf19d23a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:03.156703 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ee7bb931-8864-435a-9513-aa72cf19d23a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:03.156703 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ee7bb931-8864-435a-9513-aa72cf19d23a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:03.292616 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-ee7bb931-8864-435a-9513-aa72cf19d23a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:03.294448 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-61b4e217-fd20-4146-b79c-05a556b0f5ce tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1909219660", "imageRef": "6660bea6-dee9-43b4-95ef-29b53e1a2b28", "flavorRef": "452", "networks": [{"uuid": "0794f498-7c79-4c04-9426-97a5145b6e4e"}]}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:03.294959 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-ee7bb931-8864-435a-9513-aa72cf19d23a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.155812 Aug 27 01:32:03.295576 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 184/349] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:03 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:03.340606 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-3eee3e5e-fe15-49f3-920b-30f83a5d9195 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:03.341407 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-3eee3e5e-fe15-49f3-920b-30f83a5d9195 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:03.349541 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3eee3e5e-fe15-49f3-920b-30f83a5d9195 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:03.350397 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3eee3e5e-fe15-49f3-920b-30f83a5d9195 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:03.351194 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3eee3e5e-fe15-49f3-920b-30f83a5d9195 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:03.351630 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3eee3e5e-fe15-49f3-920b-30f83a5d9195 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:03.370487 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.network.neutron [None req-61b4e217-fd20-4146-b79c-05a556b0f5ce tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] validate_networks() for [('0794f498-7c79-4c04-9426-97a5145b6e4e', None, None, None, None, None)] {{(pid=108756) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 01:32:03.473611 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-3eee3e5e-fe15-49f3-920b-30f83a5d9195 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:03.481478 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-3eee3e5e-fe15-49f3-920b-30f83a5d9195 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1271 microversion: 2.1 time: 0.145886 Aug 27 01:32:03.491766 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 185/350] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:03 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1271 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:32:03.529182 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-91932b5b-1f40-49ed-b8fe-54a5535e4938 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:03.534186 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-91932b5b-1f40-49ed-b8fe-54a5535e4938 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:03.537330 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-91932b5b-1f40-49ed-b8fe-54a5535e4938 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:03.537870 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-91932b5b-1f40-49ed-b8fe-54a5535e4938 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:03.538927 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-91932b5b-1f40-49ed-b8fe-54a5535e4938 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:03.539495 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-91932b5b-1f40-49ed-b8fe-54a5535e4938 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:03.663764 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-91932b5b-1f40-49ed-b8fe-54a5535e4938 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 28550 microversion: 2.20 time: 0.137963 Aug 27 01:32:03.664719 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 186/351] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:32:03 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 28550 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 01:32:03.820910 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-1ebc7fe6-2135-4765-ac21-374d5ac7de07 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:03.822160 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-1ebc7fe6-2135-4765-ac21-374d5ac7de07 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:03.831056 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-61b4e217-fd20-4146-b79c-05a556b0f5ce tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Flavor limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 01:32:03.831475 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-61b4e217-fd20-4146-b79c-05a556b0f5ce tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Image limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 01:32:03.831946 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-61b4e217-fd20-4146-b79c-05a556b0f5ce tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Flavor pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 01:32:03.832533 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-61b4e217-fd20-4146-b79c-05a556b0f5ce tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Image pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 01:32:03.832966 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-61b4e217-fd20-4146-b79c-05a556b0f5ce tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 01:32:03.841361 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1ebc7fe6-2135-4765-ac21-374d5ac7de07 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:03.841811 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1ebc7fe6-2135-4765-ac21-374d5ac7de07 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:03.846651 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1ebc7fe6-2135-4765-ac21-374d5ac7de07 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:03.846651 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1ebc7fe6-2135-4765-ac21-374d5ac7de07 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:03.847014 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-61b4e217-fd20-4146-b79c-05a556b0f5ce tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:03.847014 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-61b4e217-fd20-4146-b79c-05a556b0f5ce tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:03.847014 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-61b4e217-fd20-4146-b79c-05a556b0f5ce tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:03.847014 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-61b4e217-fd20-4146-b79c-05a556b0f5ce tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:03.875463 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-61b4e217-fd20-4146-b79c-05a556b0f5ce tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Getting quotas for project 8c9439f7236d4228aea4ccc73e5d6c08. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:32:03.880147 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-61b4e217-fd20-4146-b79c-05a556b0f5ce tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Getting quotas for user 589eca6a184e4505a0c0f97efe65892e and project 8c9439f7236d4228aea4ccc73e5d6c08. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:32:03.892151 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-61b4e217-fd20-4146-b79c-05a556b0f5ce tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Going to run 1 instances... {{(pid=108756) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 01:32:03.894546 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-61b4e217-fd20-4146-b79c-05a556b0f5ce tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6660bea6-dee9-43b4-95ef-29b53e1a2b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 01:32:03.965470 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-1ebc7fe6-2135-4765-ac21-374d5ac7de07 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 28651 microversion: 2.1 time: 0.149221 Aug 27 01:32:03.970602 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 187/352] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:32:03 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 28651 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:32:04.106129 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-61b4e217-fd20-4146-b79c-05a556b0f5ce tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.817375 Aug 27 01:32:04.113378 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 166/353] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Aug 27 01:32:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 01:32:04.118537 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-9f8df87e-37c4-408f-85c1-e5474861ae82 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:04.119669 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-9f8df87e-37c4-408f-85c1-e5474861ae82 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:04.233351 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-9f8df87e-37c4-408f-85c1-e5474861ae82 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:04.244470 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-9f8df87e-37c4-408f-85c1-e5474861ae82 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06" status: 200 len: 1218 microversion: 2.1 time: 0.129048 Aug 27 01:32:04.246316 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 188/354] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:04 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06 => generated 1218 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:32:04.315901 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ddf7c2f4-16eb-44e4-97bd-ef1dd2e7db2a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:04.316563 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-ddf7c2f4-16eb-44e4-97bd-ef1dd2e7db2a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:04.322816 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ddf7c2f4-16eb-44e4-97bd-ef1dd2e7db2a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:04.323711 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ddf7c2f4-16eb-44e4-97bd-ef1dd2e7db2a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:04.325369 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ddf7c2f4-16eb-44e4-97bd-ef1dd2e7db2a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:04.325985 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ddf7c2f4-16eb-44e4-97bd-ef1dd2e7db2a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:04.466622 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ddf7c2f4-16eb-44e4-97bd-ef1dd2e7db2a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:04.475728 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-ddf7c2f4-16eb-44e4-97bd-ef1dd2e7db2a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.163985 Aug 27 01:32:04.476503 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 167/355] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:04 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:32:04.498733 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-c719b127-976d-4e86-b213-d4a098b510e1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:04.499387 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-c719b127-976d-4e86-b213-d4a098b510e1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:04.506793 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c719b127-976d-4e86-b213-d4a098b510e1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:04.509746 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c719b127-976d-4e86-b213-d4a098b510e1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:04.509746 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c719b127-976d-4e86-b213-d4a098b510e1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:04.509746 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c719b127-976d-4e86-b213-d4a098b510e1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:04.678374 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-7576a021-3f3f-4c4a-96d7-1e6e51d9cb76 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:04.680538 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-7576a021-3f3f-4c4a-96d7-1e6e51d9cb76 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:04.687187 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7576a021-3f3f-4c4a-96d7-1e6e51d9cb76 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:04.688692 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7576a021-3f3f-4c4a-96d7-1e6e51d9cb76 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:04.689793 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7576a021-3f3f-4c4a-96d7-1e6e51d9cb76 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:04.690560 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7576a021-3f3f-4c4a-96d7-1e6e51d9cb76 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:04.703557 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-c719b127-976d-4e86-b213-d4a098b510e1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:04.712391 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-c719b127-976d-4e86-b213-d4a098b510e1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1319 microversion: 2.1 time: 0.217207 Aug 27 01:32:04.713222 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 189/356] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:04 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:04.825204 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-7576a021-3f3f-4c4a-96d7-1e6e51d9cb76 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 28550 microversion: 2.20 time: 0.152544 Aug 27 01:32:04.826764 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 168/357] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:32:04 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 28550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 01:32:04.976985 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-f64574b7-9c1b-4106-8bec-b9f15d438694 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:04.977985 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-f64574b7-9c1b-4106-8bec-b9f15d438694 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:04.984106 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f64574b7-9c1b-4106-8bec-b9f15d438694 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:04.988176 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f64574b7-9c1b-4106-8bec-b9f15d438694 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:04.988176 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f64574b7-9c1b-4106-8bec-b9f15d438694 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:04.988176 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f64574b7-9c1b-4106-8bec-b9f15d438694 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:05.112931 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-f64574b7-9c1b-4106-8bec-b9f15d438694 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 28651 microversion: 2.1 time: 0.139395 Aug 27 01:32:05.114580 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 190/358] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:32:04 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 28651 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:32:05.263617 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-93b25c76-e298-400a-b18d-e54047f5f900 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:05.267979 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-93b25c76-e298-400a-b18d-e54047f5f900 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:05.273830 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-93b25c76-e298-400a-b18d-e54047f5f900 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:05.274278 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-93b25c76-e298-400a-b18d-e54047f5f900 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:05.275081 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-93b25c76-e298-400a-b18d-e54047f5f900 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:05.275627 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-93b25c76-e298-400a-b18d-e54047f5f900 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:05.355899 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-93b25c76-e298-400a-b18d-e54047f5f900 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:05.363760 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-93b25c76-e298-400a-b18d-e54047f5f900 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06" status: 200 len: 1214 microversion: 2.1 time: 0.103938 Aug 27 01:32:05.364659 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 169/359] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:05 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06 => generated 1214 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:05.495615 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d6fb758c-4cfe-45fe-845b-b2fd20460a9d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:05.496227 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d6fb758c-4cfe-45fe-845b-b2fd20460a9d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:05.502837 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d6fb758c-4cfe-45fe-845b-b2fd20460a9d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:05.503410 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d6fb758c-4cfe-45fe-845b-b2fd20460a9d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:05.504064 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d6fb758c-4cfe-45fe-845b-b2fd20460a9d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:05.504484 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d6fb758c-4cfe-45fe-845b-b2fd20460a9d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:05.623102 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-417d6984-9858-4aa8-ac40-46763838ab9f req-b0635060-4ab2-41e6-9f35-5a267a8fae35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "662047f7-1502-4db9-8e45-86b77401fa0e", "tag": "b32e536e-4fa6-43eb-9d3e-e1ee00b00d98"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:05.624622 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:32:05.624622 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:32:05.633352 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-417d6984-9858-4aa8-ac40-46763838ab9f req-b0635060-4ab2-41e6-9f35-5a267a8fae35 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:05.637511 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-417d6984-9858-4aa8-ac40-46763838ab9f req-b0635060-4ab2-41e6-9f35-5a267a8fae35 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:05.651711 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-417d6984-9858-4aa8-ac40-46763838ab9f req-b0635060-4ab2-41e6-9f35-5a267a8fae35 service nova] Creating event network-changed:b32e536e-4fa6-43eb-9d3e-e1ee00b00d98 for instance 662047f7-1502-4db9-8e45-86b77401fa0e on hv-cinder-75916 Aug 27 01:32:05.657892 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-417d6984-9858-4aa8-ac40-46763838ab9f req-b0635060-4ab2-41e6-9f35-5a267a8fae35 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038566 Aug 27 01:32:05.658548 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 170/360] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:32:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:32:05.731409 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-8a597a98-90b6-436f-81a2-a708b68caca9 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:05.732013 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-8a597a98-90b6-436f-81a2-a708b68caca9 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:05.739182 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8a597a98-90b6-436f-81a2-a708b68caca9 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:05.739623 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8a597a98-90b6-436f-81a2-a708b68caca9 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:05.740449 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8a597a98-90b6-436f-81a2-a708b68caca9 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:05.740902 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8a597a98-90b6-436f-81a2-a708b68caca9 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:05.879368 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-8a597a98-90b6-436f-81a2-a708b68caca9 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:05.887529 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-8a597a98-90b6-436f-81a2-a708b68caca9 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1319 microversion: 2.1 time: 0.160312 Aug 27 01:32:05.888101 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 171/361] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:05 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:32:05.893668 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-61037728-d5ca-42f8-95a9-7c8b00d0d2a5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:05.894580 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-61037728-d5ca-42f8-95a9-7c8b00d0d2a5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:05.901668 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-61037728-d5ca-42f8-95a9-7c8b00d0d2a5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:05.902319 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-61037728-d5ca-42f8-95a9-7c8b00d0d2a5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:05.903094 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-61037728-d5ca-42f8-95a9-7c8b00d0d2a5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:05.903527 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-61037728-d5ca-42f8-95a9-7c8b00d0d2a5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:05.932246 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d6fb758c-4cfe-45fe-845b-b2fd20460a9d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:05.944151 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d6fb758c-4cfe-45fe-845b-b2fd20460a9d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.452436 Aug 27 01:32:05.944782 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 191/362] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:05 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:06.062376 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-61037728-d5ca-42f8-95a9-7c8b00d0d2a5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 28550 microversion: 2.20 time: 0.173039 Aug 27 01:32:06.063843 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 172/363] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:32:05 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 28550 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:32:06.125833 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4c8e4efd-0814-41f9-afba-16a08ab2bbc6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:06.126751 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4c8e4efd-0814-41f9-afba-16a08ab2bbc6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:06.132458 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4c8e4efd-0814-41f9-afba-16a08ab2bbc6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:06.132933 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4c8e4efd-0814-41f9-afba-16a08ab2bbc6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:06.133697 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4c8e4efd-0814-41f9-afba-16a08ab2bbc6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:06.134132 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4c8e4efd-0814-41f9-afba-16a08ab2bbc6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:06.283657 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4c8e4efd-0814-41f9-afba-16a08ab2bbc6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 28651 microversion: 2.1 time: 0.161329 Aug 27 01:32:06.284356 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 192/364] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:32:06 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 28651 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:32:06.384406 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-0dd7d00d-0c25-4217-808d-1ddd5e1adf0b tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:06.399275 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-0dd7d00d-0c25-4217-808d-1ddd5e1adf0b tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:06.399275 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0dd7d00d-0c25-4217-808d-1ddd5e1adf0b tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:06.399275 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0dd7d00d-0c25-4217-808d-1ddd5e1adf0b tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:06.399275 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0dd7d00d-0c25-4217-808d-1ddd5e1adf0b tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:06.399580 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0dd7d00d-0c25-4217-808d-1ddd5e1adf0b tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:06.457507 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0dd7d00d-0c25-4217-808d-1ddd5e1adf0b tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:06.464920 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-0dd7d00d-0c25-4217-808d-1ddd5e1adf0b tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06" status: 200 len: 1278 microversion: 2.1 time: 0.086572 Aug 27 01:32:06.465764 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 173/365] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:06 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06 => generated 1278 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:06.905272 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-6239680a-3df0-4f98-b84e-ee974373240f tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:06.905964 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-6239680a-3df0-4f98-b84e-ee974373240f tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:06.912688 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6239680a-3df0-4f98-b84e-ee974373240f tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:06.913166 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6239680a-3df0-4f98-b84e-ee974373240f tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:06.913997 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6239680a-3df0-4f98-b84e-ee974373240f tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:06.914430 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6239680a-3df0-4f98-b84e-ee974373240f tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:06.964561 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-a1583168-4df1-408b-9cc1-51a21666c2b7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:06.965518 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-a1583168-4df1-408b-9cc1-51a21666c2b7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:06.976914 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a1583168-4df1-408b-9cc1-51a21666c2b7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:06.977382 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a1583168-4df1-408b-9cc1-51a21666c2b7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:06.978186 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a1583168-4df1-408b-9cc1-51a21666c2b7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:06.980053 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a1583168-4df1-408b-9cc1-51a21666c2b7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:07.124399 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-6239680a-3df0-4f98-b84e-ee974373240f tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:07.132806 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-a1583168-4df1-408b-9cc1-51a21666c2b7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:07.136291 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-6239680a-3df0-4f98-b84e-ee974373240f tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1319 microversion: 2.1 time: 0.235077 Aug 27 01:32:07.140048 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 193/366] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:06 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:07.144476 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-a1583168-4df1-408b-9cc1-51a21666c2b7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.182466 Aug 27 01:32:07.147152 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-bf7a167b-d515-49aa-b0ea-44a844b66f7a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:07.149732 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-bf7a167b-d515-49aa-b0ea-44a844b66f7a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:07.154051 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 174/367] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:06 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:32:07.159775 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bf7a167b-d515-49aa-b0ea-44a844b66f7a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:07.160524 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bf7a167b-d515-49aa-b0ea-44a844b66f7a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:07.161562 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bf7a167b-d515-49aa-b0ea-44a844b66f7a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:07.162194 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bf7a167b-d515-49aa-b0ea-44a844b66f7a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:07.287396 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-bf7a167b-d515-49aa-b0ea-44a844b66f7a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 28550 microversion: 2.20 time: 0.145749 Aug 27 01:32:07.288099 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 194/368] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:32:07 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 28550 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:32:07.295557 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-0c731c81-a5c5-444a-9830-100999ef1b62 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:07.296470 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-0c731c81-a5c5-444a-9830-100999ef1b62 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:07.302882 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0c731c81-a5c5-444a-9830-100999ef1b62 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:07.303327 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0c731c81-a5c5-444a-9830-100999ef1b62 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:07.304563 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0c731c81-a5c5-444a-9830-100999ef1b62 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:07.305037 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0c731c81-a5c5-444a-9830-100999ef1b62 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:07.439634 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-0c731c81-a5c5-444a-9830-100999ef1b62 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 28651 microversion: 2.1 time: 0.147494 Aug 27 01:32:07.440445 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 175/369] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:32:07 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 28651 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:32:07.485747 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d6acba92-db8d-48a6-ac60-3de62dda7e79 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:07.490823 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d6acba92-db8d-48a6-ac60-3de62dda7e79 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:07.493689 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d6acba92-db8d-48a6-ac60-3de62dda7e79 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:07.494462 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d6acba92-db8d-48a6-ac60-3de62dda7e79 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:07.495236 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d6acba92-db8d-48a6-ac60-3de62dda7e79 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:07.495661 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d6acba92-db8d-48a6-ac60-3de62dda7e79 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:07.676905 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d6acba92-db8d-48a6-ac60-3de62dda7e79 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:07.685788 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d6acba92-db8d-48a6-ac60-3de62dda7e79 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06" status: 200 len: 1318 microversion: 2.1 time: 0.205682 Aug 27 01:32:07.686959 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 195/370] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:07 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:08.154151 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-e2e00577-294d-4981-a88b-53c62a7517a1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:08.154962 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-e2e00577-294d-4981-a88b-53c62a7517a1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:08.163127 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-152fd221-c3b1-43cd-9f3b-c7525a0e22c8 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:08.164699 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-152fd221-c3b1-43cd-9f3b-c7525a0e22c8 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:08.164847 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e2e00577-294d-4981-a88b-53c62a7517a1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:08.165205 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e2e00577-294d-4981-a88b-53c62a7517a1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:08.166103 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e2e00577-294d-4981-a88b-53c62a7517a1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:08.166547 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e2e00577-294d-4981-a88b-53c62a7517a1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:08.172905 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-152fd221-c3b1-43cd-9f3b-c7525a0e22c8 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:08.173427 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-152fd221-c3b1-43cd-9f3b-c7525a0e22c8 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:08.174421 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-152fd221-c3b1-43cd-9f3b-c7525a0e22c8 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:08.174924 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-152fd221-c3b1-43cd-9f3b-c7525a0e22c8 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:08.303632 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-e2e00577-294d-4981-a88b-53c62a7517a1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:08.308607 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-e2e00577-294d-4981-a88b-53c62a7517a1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1319 microversion: 2.1 time: 0.158267 Aug 27 01:32:08.309207 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 176/371] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:08 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:08.316356 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c0fb6531-7717-418f-b04f-c349a3ed4fc5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:08.317635 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c0fb6531-7717-418f-b04f-c349a3ed4fc5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:08.324233 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c0fb6531-7717-418f-b04f-c349a3ed4fc5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:08.324942 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c0fb6531-7717-418f-b04f-c349a3ed4fc5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:08.325924 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c0fb6531-7717-418f-b04f-c349a3ed4fc5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:08.326357 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c0fb6531-7717-418f-b04f-c349a3ed4fc5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:08.364509 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-152fd221-c3b1-43cd-9f3b-c7525a0e22c8 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:08.372037 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-152fd221-c3b1-43cd-9f3b-c7525a0e22c8 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.214060 Aug 27 01:32:08.372585 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 196/372] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:08 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:08.431596 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c0fb6531-7717-418f-b04f-c349a3ed4fc5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 28550 microversion: 2.20 time: 0.120957 Aug 27 01:32:08.432272 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 177/373] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:32:08 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 28550 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:32:08.451555 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-179d70f2-ee4d-4eba-85fe-2996ac270ee3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:08.452550 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-179d70f2-ee4d-4eba-85fe-2996ac270ee3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:08.458974 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-179d70f2-ee4d-4eba-85fe-2996ac270ee3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:08.459401 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-179d70f2-ee4d-4eba-85fe-2996ac270ee3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:08.460160 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-179d70f2-ee4d-4eba-85fe-2996ac270ee3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:08.460585 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-179d70f2-ee4d-4eba-85fe-2996ac270ee3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:08.537557 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-86724f53-d78b-4f66-885c-32604b407d70 req-44ac749e-c7c5-4a4d-9727-1fb82d978592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5609c94a-0725-49da-a8dc-07496ea55d06", "tag": "313048b0-3d74-4d3f-af39-cfb37676bde6"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:08.539085 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:32:08.539085 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:32:08.548737 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-86724f53-d78b-4f66-885c-32604b407d70 req-44ac749e-c7c5-4a4d-9727-1fb82d978592 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:08.549209 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-86724f53-d78b-4f66-885c-32604b407d70 req-44ac749e-c7c5-4a4d-9727-1fb82d978592 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:08.563373 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-86724f53-d78b-4f66-885c-32604b407d70 req-44ac749e-c7c5-4a4d-9727-1fb82d978592 service nova] Creating event network-changed:313048b0-3d74-4d3f-af39-cfb37676bde6 for instance 5609c94a-0725-49da-a8dc-07496ea55d06 on hv-cinder-75916 Aug 27 01:32:08.567584 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-86724f53-d78b-4f66-885c-32604b407d70 req-44ac749e-c7c5-4a4d-9727-1fb82d978592 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034139 Aug 27 01:32:08.568165 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 178/374] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:32:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:32:08.582867 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-179d70f2-ee4d-4eba-85fe-2996ac270ee3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 28651 microversion: 2.1 time: 0.134798 Aug 27 01:32:08.587907 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 197/375] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:32:08 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 28651 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:32:08.713522 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-07805b2e-ac0c-4bea-830e-a37ea6d33ce2 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:08.714232 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-07805b2e-ac0c-4bea-830e-a37ea6d33ce2 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:08.721204 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-07805b2e-ac0c-4bea-830e-a37ea6d33ce2 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:08.721654 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-07805b2e-ac0c-4bea-830e-a37ea6d33ce2 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:08.722462 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-07805b2e-ac0c-4bea-830e-a37ea6d33ce2 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:08.722901 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-07805b2e-ac0c-4bea-830e-a37ea6d33ce2 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:08.860684 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-07805b2e-ac0c-4bea-830e-a37ea6d33ce2 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:08.868540 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-07805b2e-ac0c-4bea-830e-a37ea6d33ce2 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06" status: 200 len: 1318 microversion: 2.1 time: 0.165739 Aug 27 01:32:08.869162 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 179/376] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:08 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:09.325820 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-65be5a40-4b4c-4d70-8177-04a8c9cad5bb tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:09.326503 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-65be5a40-4b4c-4d70-8177-04a8c9cad5bb tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:09.335704 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-65be5a40-4b4c-4d70-8177-04a8c9cad5bb tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:09.335704 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-65be5a40-4b4c-4d70-8177-04a8c9cad5bb tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:09.335704 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-65be5a40-4b4c-4d70-8177-04a8c9cad5bb tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:09.335704 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-65be5a40-4b4c-4d70-8177-04a8c9cad5bb tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:09.388755 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-4a8986a6-b86e-47d0-98e5-f8812bcdb5c9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:09.389292 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-4a8986a6-b86e-47d0-98e5-f8812bcdb5c9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:09.395436 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4a8986a6-b86e-47d0-98e5-f8812bcdb5c9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:09.395883 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4a8986a6-b86e-47d0-98e5-f8812bcdb5c9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:09.396661 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4a8986a6-b86e-47d0-98e5-f8812bcdb5c9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:09.397219 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4a8986a6-b86e-47d0-98e5-f8812bcdb5c9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:09.544234 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-65be5a40-4b4c-4d70-8177-04a8c9cad5bb tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:09.555536 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-4a8986a6-b86e-47d0-98e5-f8812bcdb5c9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:09.558994 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-65be5a40-4b4c-4d70-8177-04a8c9cad5bb tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1319 microversion: 2.1 time: 0.237046 Aug 27 01:32:09.560031 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 198/377] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:09 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:09.566910 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b5d49467-fdae-414a-8247-90e634bf7eed tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:09.568134 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b5d49467-fdae-414a-8247-90e634bf7eed tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:09.574653 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b5d49467-fdae-414a-8247-90e634bf7eed tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:09.575386 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b5d49467-fdae-414a-8247-90e634bf7eed tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:09.576374 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b5d49467-fdae-414a-8247-90e634bf7eed tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:09.577063 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b5d49467-fdae-414a-8247-90e634bf7eed tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:09.577689 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-4a8986a6-b86e-47d0-98e5-f8812bcdb5c9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.190549 Aug 27 01:32:09.587744 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 180/378] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:09 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:32:09.596337 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-d2e5f993-04f6-44e8-9d14-a127a6a79913 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:09.597819 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-d2e5f993-04f6-44e8-9d14-a127a6a79913 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:09.620664 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d2e5f993-04f6-44e8-9d14-a127a6a79913 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:09.621953 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d2e5f993-04f6-44e8-9d14-a127a6a79913 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:09.625571 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d2e5f993-04f6-44e8-9d14-a127a6a79913 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:09.626347 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d2e5f993-04f6-44e8-9d14-a127a6a79913 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:09.737155 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b5d49467-fdae-414a-8247-90e634bf7eed tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 28823 microversion: 2.20 time: 0.174333 Aug 27 01:32:09.738081 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 199/379] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:32:09 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 28823 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:32:09.779704 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-d2e5f993-04f6-44e8-9d14-a127a6a79913 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 29380 microversion: 2.1 time: 0.188744 Aug 27 01:32:09.781200 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 181/380] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:32:09 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 29380 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:32:09.887019 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b661a34b-b526-4342-a7e3-8dc5133c3d81 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:09.887792 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b661a34b-b526-4342-a7e3-8dc5133c3d81 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:09.895628 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b661a34b-b526-4342-a7e3-8dc5133c3d81 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:09.896626 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b661a34b-b526-4342-a7e3-8dc5133c3d81 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:09.896872 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b661a34b-b526-4342-a7e3-8dc5133c3d81 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:09.897742 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b661a34b-b526-4342-a7e3-8dc5133c3d81 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:10.038251 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-b661a34b-b526-4342-a7e3-8dc5133c3d81 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:10.050722 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b661a34b-b526-4342-a7e3-8dc5133c3d81 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06" status: 200 len: 1318 microversion: 2.1 time: 0.167644 Aug 27 01:32:10.051995 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 200/381] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:09 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:10.576173 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-10a28487-92db-4e02-a1c5-6b1257cdf33a tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:10.576887 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-10a28487-92db-4e02-a1c5-6b1257cdf33a tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:10.583629 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-10a28487-92db-4e02-a1c5-6b1257cdf33a tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:10.584077 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-10a28487-92db-4e02-a1c5-6b1257cdf33a tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:10.584862 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-10a28487-92db-4e02-a1c5-6b1257cdf33a tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:10.585319 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-10a28487-92db-4e02-a1c5-6b1257cdf33a tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:10.594728 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-cea1c214-de72-4dc3-829f-562b84cb57db tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:10.595337 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-cea1c214-de72-4dc3-829f-562b84cb57db tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:10.601694 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-cea1c214-de72-4dc3-829f-562b84cb57db tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:10.602171 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-cea1c214-de72-4dc3-829f-562b84cb57db tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:10.602941 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-cea1c214-de72-4dc3-829f-562b84cb57db tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:10.603572 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-cea1c214-de72-4dc3-829f-562b84cb57db tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:10.725314 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-10a28487-92db-4e02-a1c5-6b1257cdf33a tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:10.734210 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-10a28487-92db-4e02-a1c5-6b1257cdf33a tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1319 microversion: 2.1 time: 0.161981 Aug 27 01:32:10.735245 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-cea1c214-de72-4dc3-829f-562b84cb57db tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:10.736938 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 182/382] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:10 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:10.743131 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-cea1c214-de72-4dc3-829f-562b84cb57db tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.151935 Aug 27 01:32:10.743838 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 201/383] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:10 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:32:10.749265 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-534b129e-4d0d-4355-a3fa-f940063e166a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:10.750395 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-534b129e-4d0d-4355-a3fa-f940063e166a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:10.756173 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-534b129e-4d0d-4355-a3fa-f940063e166a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:10.756623 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-534b129e-4d0d-4355-a3fa-f940063e166a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:10.757435 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-534b129e-4d0d-4355-a3fa-f940063e166a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:10.757866 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-534b129e-4d0d-4355-a3fa-f940063e166a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:10.791299 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-6a9fb434-6c21-4695-8ef5-119ea0a92f01 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:10.792264 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-6a9fb434-6c21-4695-8ef5-119ea0a92f01 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:10.797990 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6a9fb434-6c21-4695-8ef5-119ea0a92f01 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:10.798431 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6a9fb434-6c21-4695-8ef5-119ea0a92f01 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:10.799190 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6a9fb434-6c21-4695-8ef5-119ea0a92f01 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:10.800647 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6a9fb434-6c21-4695-8ef5-119ea0a92f01 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:12.841345 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-534b129e-4d0d-4355-a3fa-f940063e166a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 33484 microversion: 2.20 time: 2.095615 Aug 27 01:32:12.841990 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 183/384] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:32:10 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 33484 bytes in 2097 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 01:32:12.847419 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-4a4be02d-4a8f-41c3-9407-6e405aca968b tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:12.848161 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-4a4be02d-4a8f-41c3-9407-6e405aca968b tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:12.854482 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4a4be02d-4a8f-41c3-9407-6e405aca968b tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:12.854921 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4a4be02d-4a8f-41c3-9407-6e405aca968b tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:12.855681 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4a4be02d-4a8f-41c3-9407-6e405aca968b tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:12.856108 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4a4be02d-4a8f-41c3-9407-6e405aca968b tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:12.874669 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-6a9fb434-6c21-4695-8ef5-119ea0a92f01 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 32925 microversion: 2.1 time: 2.086786 Aug 27 01:32:12.875989 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 202/385] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:32:10 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 32925 bytes in 2089 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:32:12.881121 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-bb73f81c-efc8-4de6-a4b6-c05c741111b1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:12.881964 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-bb73f81c-efc8-4de6-a4b6-c05c741111b1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:12.889412 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bb73f81c-efc8-4de6-a4b6-c05c741111b1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:12.898183 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bb73f81c-efc8-4de6-a4b6-c05c741111b1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:12.898183 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bb73f81c-efc8-4de6-a4b6-c05c741111b1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:12.898183 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bb73f81c-efc8-4de6-a4b6-c05c741111b1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:13.013097 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-4a4be02d-4a8f-41c3-9407-6e405aca968b tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:13.021429 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-4a4be02d-4a8f-41c3-9407-6e405aca968b tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06" status: 200 len: 1318 microversion: 2.1 time: 0.178284 Aug 27 01:32:13.022089 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 184/386] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:12 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:13.026696 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-3d4005f0-2f77-4925-b187-20ae110b5dbc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:13.027491 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-3d4005f0-2f77-4925-b187-20ae110b5dbc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:13.034888 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3d4005f0-2f77-4925-b187-20ae110b5dbc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:13.035924 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3d4005f0-2f77-4925-b187-20ae110b5dbc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:13.036908 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3d4005f0-2f77-4925-b187-20ae110b5dbc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:13.037438 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3d4005f0-2f77-4925-b187-20ae110b5dbc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:13.037614 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-bb73f81c-efc8-4de6-a4b6-c05c741111b1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:13.045136 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-bb73f81c-efc8-4de6-a4b6-c05c741111b1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1319 microversion: 2.1 time: 0.167773 Aug 27 01:32:13.045793 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 203/387] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:12 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:13.162245 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-3d4005f0-2f77-4925-b187-20ae110b5dbc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:13.169532 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-3d4005f0-2f77-4925-b187-20ae110b5dbc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.146472 Aug 27 01:32:13.170082 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 185/388] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:13 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:13.853892 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-a9c496c2-0433-4f0d-a93c-35ee55d3aca7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:13.854856 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-a9c496c2-0433-4f0d-a93c-35ee55d3aca7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:13.861332 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a9c496c2-0433-4f0d-a93c-35ee55d3aca7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:13.861859 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a9c496c2-0433-4f0d-a93c-35ee55d3aca7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:13.862698 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a9c496c2-0433-4f0d-a93c-35ee55d3aca7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:13.863264 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a9c496c2-0433-4f0d-a93c-35ee55d3aca7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:13.887565 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-162072d2-d926-4040-98bc-e9af2fd9cc66 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:13.888527 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-162072d2-d926-4040-98bc-e9af2fd9cc66 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:13.895686 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-162072d2-d926-4040-98bc-e9af2fd9cc66 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:13.896126 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-162072d2-d926-4040-98bc-e9af2fd9cc66 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:13.896949 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-162072d2-d926-4040-98bc-e9af2fd9cc66 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:13.897384 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-162072d2-d926-4040-98bc-e9af2fd9cc66 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:14.023098 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-a9c496c2-0433-4f0d-a93c-35ee55d3aca7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 33927 microversion: 2.20 time: 0.172808 Aug 27 01:32:14.023798 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 204/389] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:32:13 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 33927 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:32:14.038635 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-20e1b578-b04c-4319-9ece-87508ce2c6b8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:14.040105 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-20e1b578-b04c-4319-9ece-87508ce2c6b8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:14.046137 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-20e1b578-b04c-4319-9ece-87508ce2c6b8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:14.046583 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-20e1b578-b04c-4319-9ece-87508ce2c6b8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:14.047778 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-20e1b578-b04c-4319-9ece-87508ce2c6b8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:14.048210 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-20e1b578-b04c-4319-9ece-87508ce2c6b8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:14.064913 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-162072d2-d926-4040-98bc-e9af2fd9cc66 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 33251 microversion: 2.1 time: 0.180519 Aug 27 01:32:14.066576 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 186/390] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:32:13 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 33251 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:32:14.071816 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-e30052ea-c6e4-4635-a987-58e3ba8f8afe tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:14.074039 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-e30052ea-c6e4-4635-a987-58e3ba8f8afe tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:14.081285 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e30052ea-c6e4-4635-a987-58e3ba8f8afe tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:14.081737 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e30052ea-c6e4-4635-a987-58e3ba8f8afe tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:14.082698 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e30052ea-c6e4-4635-a987-58e3ba8f8afe tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:14.083135 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e30052ea-c6e4-4635-a987-58e3ba8f8afe tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:14.177595 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-20e1b578-b04c-4319-9ece-87508ce2c6b8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:14.185674 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-20e1b578-b04c-4319-9ece-87508ce2c6b8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06" status: 200 len: 1318 microversion: 2.1 time: 0.150913 Aug 27 01:32:14.186519 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 205/391] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:14 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:32:14.191151 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4b97228b-e13d-49a0-ba7c-b21e5daa37d1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:14.191779 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4b97228b-e13d-49a0-ba7c-b21e5daa37d1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:14.197789 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4b97228b-e13d-49a0-ba7c-b21e5daa37d1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:14.198413 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4b97228b-e13d-49a0-ba7c-b21e5daa37d1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:14.199348 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4b97228b-e13d-49a0-ba7c-b21e5daa37d1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:14.199922 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4b97228b-e13d-49a0-ba7c-b21e5daa37d1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:14.236198 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-e30052ea-c6e4-4635-a987-58e3ba8f8afe tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:14.244117 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-e30052ea-c6e4-4635-a987-58e3ba8f8afe tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1319 microversion: 2.1 time: 0.176162 Aug 27 01:32:14.244938 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 187/392] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:14 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:14.336082 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4b97228b-e13d-49a0-ba7c-b21e5daa37d1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:14.343499 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4b97228b-e13d-49a0-ba7c-b21e5daa37d1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.155737 Aug 27 01:32:14.344689 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 206/393] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:14 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:15.035599 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-1d1deb1b-dc5f-456e-af51-61836125ccc4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:15.036428 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-1d1deb1b-dc5f-456e-af51-61836125ccc4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:15.042677 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1d1deb1b-dc5f-456e-af51-61836125ccc4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:15.043417 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1d1deb1b-dc5f-456e-af51-61836125ccc4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:15.044394 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1d1deb1b-dc5f-456e-af51-61836125ccc4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:15.046819 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1d1deb1b-dc5f-456e-af51-61836125ccc4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:15.078549 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-55269de7-72bb-4141-a5d0-f948ec97b45c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:15.078549 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-55269de7-72bb-4141-a5d0-f948ec97b45c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:15.092575 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-55269de7-72bb-4141-a5d0-f948ec97b45c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:15.093250 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-55269de7-72bb-4141-a5d0-f948ec97b45c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:15.094688 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-55269de7-72bb-4141-a5d0-f948ec97b45c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:15.095031 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-55269de7-72bb-4141-a5d0-f948ec97b45c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:15.363861 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-55269de7-72bb-4141-a5d0-f948ec97b45c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 33706 microversion: 2.1 time: 0.290601 Aug 27 01:32:15.364501 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 207/394] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:32:15 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 33706 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:32:15.369480 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-f38262f6-8c96-4807-b1e2-e44e5c08b2d5 req-53b63681-0fd1-4d65-a690-e13c50b9e2c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662047f7-1502-4db9-8e45-86b77401fa0e", "name": "network-vif-plugged", "status": "completed", "tag": "b32e536e-4fa6-43eb-9d3e-e1ee00b00d98"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:15.370930 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:32:15.370930 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:32:15.379218 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-f38262f6-8c96-4807-b1e2-e44e5c08b2d5 req-53b63681-0fd1-4d65-a690-e13c50b9e2c6 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:15.379798 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-f38262f6-8c96-4807-b1e2-e44e5c08b2d5 req-53b63681-0fd1-4d65-a690-e13c50b9e2c6 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:15.392636 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-f38262f6-8c96-4807-b1e2-e44e5c08b2d5 req-53b63681-0fd1-4d65-a690-e13c50b9e2c6 service nova] Creating event network-vif-plugged:b32e536e-4fa6-43eb-9d3e-e1ee00b00d98 for instance 662047f7-1502-4db9-8e45-86b77401fa0e on hv-cinder-75916 Aug 27 01:32:15.398653 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-1d1deb1b-dc5f-456e-af51-61836125ccc4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 34489 microversion: 2.20 time: 0.367327 Aug 27 01:32:15.400165 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 188/395] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:32:15 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 34489 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:32:15.409215 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-f38262f6-8c96-4807-b1e2-e44e5c08b2d5 req-53b63681-0fd1-4d65-a690-e13c50b9e2c6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042967 Aug 27 01:32:15.409358 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-bc5a8876-6860-4199-82ee-88aaff4043e3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:15.409872 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 208/396] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:32:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:32:15.410080 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-bc5a8876-6860-4199-82ee-88aaff4043e3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:15.415280 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4dc89768-6265-48de-8ce5-ce0b044a1e3f tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:15.415756 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4dc89768-6265-48de-8ce5-ce0b044a1e3f tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:15.422732 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4dc89768-6265-48de-8ce5-ce0b044a1e3f tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:15.423349 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4dc89768-6265-48de-8ce5-ce0b044a1e3f tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:15.423607 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bc5a8876-6860-4199-82ee-88aaff4043e3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:15.424055 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bc5a8876-6860-4199-82ee-88aaff4043e3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:15.424157 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4dc89768-6265-48de-8ce5-ce0b044a1e3f tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:15.424530 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4dc89768-6265-48de-8ce5-ce0b044a1e3f tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:15.424859 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bc5a8876-6860-4199-82ee-88aaff4043e3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:15.425291 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bc5a8876-6860-4199-82ee-88aaff4043e3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:15.567469 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-bc5a8876-6860-4199-82ee-88aaff4043e3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:15.567616 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4dc89768-6265-48de-8ce5-ce0b044a1e3f tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:15.575426 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-bc5a8876-6860-4199-82ee-88aaff4043e3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06" status: 200 len: 1318 microversion: 2.1 time: 0.173852 Aug 27 01:32:15.576723 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 189/397] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:15 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:15.578593 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4dc89768-6265-48de-8ce5-ce0b044a1e3f tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1319 microversion: 2.1 time: 0.167518 Aug 27 01:32:15.579542 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 209/398] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:15 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:15.581137 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-2435639d-7535-4964-8245-324ce6cba17d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:15.583162 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-2435639d-7535-4964-8245-324ce6cba17d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:15.588996 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2435639d-7535-4964-8245-324ce6cba17d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:15.589433 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2435639d-7535-4964-8245-324ce6cba17d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:15.590343 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2435639d-7535-4964-8245-324ce6cba17d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:15.590916 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2435639d-7535-4964-8245-324ce6cba17d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:15.720802 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-2435639d-7535-4964-8245-324ce6cba17d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:15.728421 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-2435639d-7535-4964-8245-324ce6cba17d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.151439 Aug 27 01:32:15.729093 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 190/399] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:15 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:16.375441 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-df404c21-99ae-472c-b34d-74c90ef964cd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:16.376407 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-df404c21-99ae-472c-b34d-74c90ef964cd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:16.383871 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-df404c21-99ae-472c-b34d-74c90ef964cd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:16.384316 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-df404c21-99ae-472c-b34d-74c90ef964cd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:16.385107 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-df404c21-99ae-472c-b34d-74c90ef964cd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:16.385556 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-df404c21-99ae-472c-b34d-74c90ef964cd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:16.411782 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c91a347e-6214-451e-8f5f-053afaeb7cab tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:16.414413 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c91a347e-6214-451e-8f5f-053afaeb7cab tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:16.420882 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c91a347e-6214-451e-8f5f-053afaeb7cab tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:16.421496 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c91a347e-6214-451e-8f5f-053afaeb7cab tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:16.423154 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c91a347e-6214-451e-8f5f-053afaeb7cab tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:16.423602 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c91a347e-6214-451e-8f5f-053afaeb7cab tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:16.709306 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-df404c21-99ae-472c-b34d-74c90ef964cd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 34181 microversion: 2.1 time: 0.337266 Aug 27 01:32:16.713272 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 210/400] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:32:16 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 34181 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:32:16.714834 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-fec42e1c-b440-4335-8595-5a512cf72fda tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:16.715512 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-fec42e1c-b440-4335-8595-5a512cf72fda tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:16.722146 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fec42e1c-b440-4335-8595-5a512cf72fda tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:16.722586 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fec42e1c-b440-4335-8595-5a512cf72fda tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:16.723337 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fec42e1c-b440-4335-8595-5a512cf72fda tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:16.723763 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fec42e1c-b440-4335-8595-5a512cf72fda tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:16.787720 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c91a347e-6214-451e-8f5f-053afaeb7cab tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 35022 microversion: 2.20 time: 0.379622 Aug 27 01:32:16.788629 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 191/401] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:32:16 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 35022 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:32:16.795169 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-3cea53b2-edcc-43fb-a4c4-733af8ea2b29 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:16.795860 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-3cea53b2-edcc-43fb-a4c4-733af8ea2b29 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:16.802824 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3cea53b2-edcc-43fb-a4c4-733af8ea2b29 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:16.803940 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3cea53b2-edcc-43fb-a4c4-733af8ea2b29 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:16.804722 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3cea53b2-edcc-43fb-a4c4-733af8ea2b29 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:16.805206 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3cea53b2-edcc-43fb-a4c4-733af8ea2b29 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:16.862303 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-fec42e1c-b440-4335-8595-5a512cf72fda tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:16.870142 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-fec42e1c-b440-4335-8595-5a512cf72fda tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06" status: 200 len: 1318 microversion: 2.1 time: 0.158781 Aug 27 01:32:16.871396 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 211/402] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:16 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:16.882155 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-89452f0a-4cf2-4216-8a15-6aa4ce7e69ba tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:16.882965 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-89452f0a-4cf2-4216-8a15-6aa4ce7e69ba tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:16.890187 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-89452f0a-4cf2-4216-8a15-6aa4ce7e69ba tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:16.891475 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-89452f0a-4cf2-4216-8a15-6aa4ce7e69ba tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:16.892295 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-89452f0a-4cf2-4216-8a15-6aa4ce7e69ba tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:16.892766 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-89452f0a-4cf2-4216-8a15-6aa4ce7e69ba tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:16.944101 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-3cea53b2-edcc-43fb-a4c4-733af8ea2b29 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:16.954431 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-3cea53b2-edcc-43fb-a4c4-733af8ea2b29 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1319 microversion: 2.1 time: 0.164325 Aug 27 01:32:16.955010 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 192/403] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:16 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:17.033999 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-89452f0a-4cf2-4216-8a15-6aa4ce7e69ba tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:17.041212 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-89452f0a-4cf2-4216-8a15-6aa4ce7e69ba tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1522 microversion: 2.1 time: 0.168677 Aug 27 01:32:17.041768 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 212/404] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:16 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:17.721495 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-e075e73e-19c6-4867-9a92-8425746bf3ad tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:17.722498 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-e075e73e-19c6-4867-9a92-8425746bf3ad tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:17.728425 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e075e73e-19c6-4867-9a92-8425746bf3ad tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:17.728892 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e075e73e-19c6-4867-9a92-8425746bf3ad tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:17.729662 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e075e73e-19c6-4867-9a92-8425746bf3ad tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:17.730093 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e075e73e-19c6-4867-9a92-8425746bf3ad tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:17.799851 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b945c1db-656d-4787-826c-5fabbf79d80b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:17.800814 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b945c1db-656d-4787-826c-5fabbf79d80b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:17.807538 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b945c1db-656d-4787-826c-5fabbf79d80b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:17.808008 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b945c1db-656d-4787-826c-5fabbf79d80b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:17.808763 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b945c1db-656d-4787-826c-5fabbf79d80b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:17.809218 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b945c1db-656d-4787-826c-5fabbf79d80b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:21.015295 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-e075e73e-19c6-4867-9a92-8425746bf3ad tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 36622 microversion: 2.1 time: 3.298038 Aug 27 01:32:21.018383 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 193/405] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:32:17 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 36622 bytes in 3302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:32:21.025352 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-9847ffd7-c5f9-4671-9d38-bfb011a09f59 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:21.026059 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-9847ffd7-c5f9-4671-9d38-bfb011a09f59 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:21.032968 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9847ffd7-c5f9-4671-9d38-bfb011a09f59 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:21.033634 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9847ffd7-c5f9-4671-9d38-bfb011a09f59 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:21.034421 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9847ffd7-c5f9-4671-9d38-bfb011a09f59 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:21.034859 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9847ffd7-c5f9-4671-9d38-bfb011a09f59 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:21.116824 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b945c1db-656d-4787-826c-5fabbf79d80b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 37415 microversion: 2.20 time: 3.320518 Aug 27 01:32:21.117881 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 213/406] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:32:17 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 37415 bytes in 3322 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 01:32:21.123115 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-ecda6e95-c43b-4d16-804d-3a039c14b323 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:21.124406 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-ecda6e95-c43b-4d16-804d-3a039c14b323 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:21.130708 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ecda6e95-c43b-4d16-804d-3a039c14b323 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:21.131155 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ecda6e95-c43b-4d16-804d-3a039c14b323 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:21.132145 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ecda6e95-c43b-4d16-804d-3a039c14b323 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:21.132523 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ecda6e95-c43b-4d16-804d-3a039c14b323 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:21.174856 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-9847ffd7-c5f9-4671-9d38-bfb011a09f59 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:21.182632 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-9847ffd7-c5f9-4671-9d38-bfb011a09f59 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06" status: 200 len: 1318 microversion: 2.1 time: 0.162644 Aug 27 01:32:21.183193 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 194/407] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:21 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:21.188188 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-8a451271-a4cb-447c-aba9-1fe78b3082ac tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:21.188785 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-8a451271-a4cb-447c-aba9-1fe78b3082ac tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:21.196114 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8a451271-a4cb-447c-aba9-1fe78b3082ac tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:21.196559 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8a451271-a4cb-447c-aba9-1fe78b3082ac tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:21.197539 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8a451271-a4cb-447c-aba9-1fe78b3082ac tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:21.197983 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8a451271-a4cb-447c-aba9-1fe78b3082ac tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:21.287532 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-ecda6e95-c43b-4d16-804d-3a039c14b323 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:21.294767 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-ecda6e95-c43b-4d16-804d-3a039c14b323 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1319 microversion: 2.1 time: 0.176172 Aug 27 01:32:21.295313 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 214/408] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:21 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:21.300272 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-d77ad795-f4ce-407a-b09b-89e58570fc63 req-69fb9a52-aba7-4456-ae27-7ce61ec0ac31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5609c94a-0725-49da-a8dc-07496ea55d06", "name": "network-vif-plugged", "status": "completed", "tag": "313048b0-3d74-4d3f-af39-cfb37676bde6"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:21.301784 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:32:21.301784 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:32:21.308521 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-d77ad795-f4ce-407a-b09b-89e58570fc63 req-69fb9a52-aba7-4456-ae27-7ce61ec0ac31 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:21.309047 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-d77ad795-f4ce-407a-b09b-89e58570fc63 req-69fb9a52-aba7-4456-ae27-7ce61ec0ac31 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:21.319869 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-d77ad795-f4ce-407a-b09b-89e58570fc63 req-69fb9a52-aba7-4456-ae27-7ce61ec0ac31 service nova] Creating event network-vif-plugged:313048b0-3d74-4d3f-af39-cfb37676bde6 for instance 5609c94a-0725-49da-a8dc-07496ea55d06 on hv-cinder-75916 Aug 27 01:32:21.324900 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-d77ad795-f4ce-407a-b09b-89e58570fc63 req-69fb9a52-aba7-4456-ae27-7ce61ec0ac31 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028322 Aug 27 01:32:21.325438 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 215/409] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:32:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:32:21.327795 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-8a451271-a4cb-447c-aba9-1fe78b3082ac tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:21.335626 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-8a451271-a4cb-447c-aba9-1fe78b3082ac tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1502 microversion: 2.1 time: 0.151171 Aug 27 01:32:21.336180 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 195/410] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:21 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:21.394139 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-96566c66-8be2-431a-a05e-786cd761b65e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:21.394820 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-96566c66-8be2-431a-a05e-786cd761b65e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:21.401093 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-96566c66-8be2-431a-a05e-786cd761b65e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:21.401529 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-96566c66-8be2-431a-a05e-786cd761b65e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:21.402279 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-96566c66-8be2-431a-a05e-786cd761b65e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:21.402701 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-96566c66-8be2-431a-a05e-786cd761b65e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:21.566879 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-96566c66-8be2-431a-a05e-786cd761b65e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:21.574131 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-96566c66-8be2-431a-a05e-786cd761b65e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1515 microversion: 2.1 time: 0.183926 Aug 27 01:32:21.574691 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 216/411] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:21 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:22.029205 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-bc631632-c94c-42f2-895c-ee8014c72c3f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:22.030436 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-bc631632-c94c-42f2-895c-ee8014c72c3f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:22.038193 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bc631632-c94c-42f2-895c-ee8014c72c3f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:22.038658 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bc631632-c94c-42f2-895c-ee8014c72c3f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:22.039864 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bc631632-c94c-42f2-895c-ee8014c72c3f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:22.040480 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bc631632-c94c-42f2-895c-ee8014c72c3f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:22.130206 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-a68a3c7a-dc7a-4b4c-81bc-7f11b493d115 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:22.131230 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-a68a3c7a-dc7a-4b4c-81bc-7f11b493d115 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:22.137780 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a68a3c7a-dc7a-4b4c-81bc-7f11b493d115 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:22.138297 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a68a3c7a-dc7a-4b4c-81bc-7f11b493d115 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:22.139036 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a68a3c7a-dc7a-4b4c-81bc-7f11b493d115 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:22.139469 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a68a3c7a-dc7a-4b4c-81bc-7f11b493d115 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:22.552565 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-a68a3c7a-dc7a-4b4c-81bc-7f11b493d115 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 38008 microversion: 2.20 time: 0.425978 Aug 27 01:32:22.554937 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 217/412] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:32:22 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 38008 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 01:32:22.559754 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-16c6242e-a83d-485a-92c8-398f5a8102cd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:22.560107 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-16c6242e-a83d-485a-92c8-398f5a8102cd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:22.567369 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-16c6242e-a83d-485a-92c8-398f5a8102cd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:22.570382 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-16c6242e-a83d-485a-92c8-398f5a8102cd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:22.570382 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-16c6242e-a83d-485a-92c8-398f5a8102cd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:22.570382 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-16c6242e-a83d-485a-92c8-398f5a8102cd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:22.599041 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-bc631632-c94c-42f2-895c-ee8014c72c3f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 37337 microversion: 2.1 time: 0.573542 Aug 27 01:32:22.599685 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 196/413] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:32:22 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 37337 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:32:22.604988 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-feed6118-e951-4ccd-9684-b3bcf0c3558b tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:22.605665 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-feed6118-e951-4ccd-9684-b3bcf0c3558b tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:22.615442 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-feed6118-e951-4ccd-9684-b3bcf0c3558b tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:22.615990 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-feed6118-e951-4ccd-9684-b3bcf0c3558b tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:22.616889 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-feed6118-e951-4ccd-9684-b3bcf0c3558b tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:22.617332 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-feed6118-e951-4ccd-9684-b3bcf0c3558b tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:22.695965 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-16c6242e-a83d-485a-92c8-398f5a8102cd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:22.706242 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-16c6242e-a83d-485a-92c8-398f5a8102cd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06" status: 200 len: 1318 microversion: 2.1 time: 0.150278 Aug 27 01:32:22.706814 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 218/414] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:22 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:22.746330 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-feed6118-e951-4ccd-9684-b3bcf0c3558b tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:22.753975 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-feed6118-e951-4ccd-9684-b3bcf0c3558b tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1509 microversion: 2.1 time: 0.152880 Aug 27 01:32:22.754531 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 197/415] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:22 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:23.421495 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-fc602a53-5932-4945-a6b4-6f80a8f73037 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:23.423529 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-fc602a53-5932-4945-a6b4-6f80a8f73037 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:23.439335 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fc602a53-5932-4945-a6b4-6f80a8f73037 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:23.439781 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fc602a53-5932-4945-a6b4-6f80a8f73037 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:23.440559 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fc602a53-5932-4945-a6b4-6f80a8f73037 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:23.441267 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fc602a53-5932-4945-a6b4-6f80a8f73037 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:23.464717 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.objects.instance [None req-fc602a53-5932-4945-a6b4-6f80a8f73037 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lazy-loading 'flavor' on Instance uuid 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 {{(pid=108755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:32:23.567107 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-e0828440-92b9-40ca-bc7e-4332718a05a1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:23.568660 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-e0828440-92b9-40ca-bc7e-4332718a05a1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:23.576878 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e0828440-92b9-40ca-bc7e-4332718a05a1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:23.577326 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e0828440-92b9-40ca-bc7e-4332718a05a1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:23.578103 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e0828440-92b9-40ca-bc7e-4332718a05a1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:23.578607 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e0828440-92b9-40ca-bc7e-4332718a05a1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:23.822822 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-fc602a53-5932-4945-a6b4-6f80a8f73037 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "POST /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118/action" status: 200 len: 32 microversion: 2.1 time: 0.412663 Aug 27 01:32:23.823599 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 219/416] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:32:23 2021] POST /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118/action => generated 32 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 01:32:23.832109 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-a75d4cad-9a65-447f-85f7-904a8e55aede tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:23.832931 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-e0828440-92b9-40ca-bc7e-4332718a05a1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 38008 microversion: 2.20 time: 0.270699 Aug 27 01:32:23.839344 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 198/417] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:32:23 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 38008 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:32:23.839549 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-a75d4cad-9a65-447f-85f7-904a8e55aede tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:23.839707 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-5eab0c06-8511-43f4-84f0-54e42ec1930e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:23.839707 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-5eab0c06-8511-43f4-84f0-54e42ec1930e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:23.842857 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a75d4cad-9a65-447f-85f7-904a8e55aede tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:23.843446 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a75d4cad-9a65-447f-85f7-904a8e55aede tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:23.845435 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a75d4cad-9a65-447f-85f7-904a8e55aede tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:23.846056 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a75d4cad-9a65-447f-85f7-904a8e55aede tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:23.847281 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5eab0c06-8511-43f4-84f0-54e42ec1930e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:23.849953 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5eab0c06-8511-43f4-84f0-54e42ec1930e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:23.849953 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5eab0c06-8511-43f4-84f0-54e42ec1930e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:23.849953 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5eab0c06-8511-43f4-84f0-54e42ec1930e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:23.971090 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-5eab0c06-8511-43f4-84f0-54e42ec1930e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:23.978721 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-5eab0c06-8511-43f4-84f0-54e42ec1930e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06" status: 200 len: 1318 microversion: 2.1 time: 0.143709 Aug 27 01:32:23.979281 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 199/418] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:23 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:23.983615 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-bf5a9432-5673-4c77-88f5-6d6cdbd792a1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:23.984215 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-bf5a9432-5673-4c77-88f5-6d6cdbd792a1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:23.990750 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bf5a9432-5673-4c77-88f5-6d6cdbd792a1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:23.991198 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bf5a9432-5673-4c77-88f5-6d6cdbd792a1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:23.991963 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bf5a9432-5673-4c77-88f5-6d6cdbd792a1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:23.992397 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bf5a9432-5673-4c77-88f5-6d6cdbd792a1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:24.121790 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-a75d4cad-9a65-447f-85f7-904a8e55aede tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 38043 microversion: 2.1 time: 0.296203 Aug 27 01:32:24.122506 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 220/419] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:32:23 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 38043 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:32:24.124295 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-bf5a9432-5673-4c77-88f5-6d6cdbd792a1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:24.132816 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-bf5a9432-5673-4c77-88f5-6d6cdbd792a1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.152554 Aug 27 01:32:24.133396 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 200/420] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:23 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:24.849438 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-20acb5bc-3af7-4a44-a589-9e9257f1a23b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:24.850597 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-20acb5bc-3af7-4a44-a589-9e9257f1a23b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:24.857531 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-20acb5bc-3af7-4a44-a589-9e9257f1a23b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:24.857978 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-20acb5bc-3af7-4a44-a589-9e9257f1a23b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:24.858758 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-20acb5bc-3af7-4a44-a589-9e9257f1a23b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:24.859193 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-20acb5bc-3af7-4a44-a589-9e9257f1a23b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:24.994428 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-20acb5bc-3af7-4a44-a589-9e9257f1a23b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 38008 microversion: 2.20 time: 0.150757 Aug 27 01:32:24.998744 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c94d2f93-fe62-4a8c-b4ca-40a452e8fc04 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:24.999252 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 221/421] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:32:24 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 38008 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:32:24.999347 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c94d2f93-fe62-4a8c-b4ca-40a452e8fc04 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:25.002827 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c94d2f93-fe62-4a8c-b4ca-40a452e8fc04 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:25.003268 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c94d2f93-fe62-4a8c-b4ca-40a452e8fc04 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:25.004046 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c94d2f93-fe62-4a8c-b4ca-40a452e8fc04 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:25.004507 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c94d2f93-fe62-4a8c-b4ca-40a452e8fc04 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:25.134130 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-81f563bc-da3d-44cd-84dd-febcf478ad31 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:25.135201 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-81f563bc-da3d-44cd-84dd-febcf478ad31 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:25.142329 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-81f563bc-da3d-44cd-84dd-febcf478ad31 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:25.143067 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-81f563bc-da3d-44cd-84dd-febcf478ad31 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:25.143901 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-81f563bc-da3d-44cd-84dd-febcf478ad31 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:25.144396 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-81f563bc-da3d-44cd-84dd-febcf478ad31 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:25.154017 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c94d2f93-fe62-4a8c-b4ca-40a452e8fc04 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:25.162299 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c94d2f93-fe62-4a8c-b4ca-40a452e8fc04 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06" status: 200 len: 1508 microversion: 2.1 time: 0.170530 Aug 27 01:32:25.162977 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 201/422] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:24 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:32:25.167740 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ad90b2f9-ede9-4e2f-b70e-f09e6e366055 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:25.168343 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-ad90b2f9-ede9-4e2f-b70e-f09e6e366055 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:25.176235 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ad90b2f9-ede9-4e2f-b70e-f09e6e366055 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:25.176605 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ad90b2f9-ede9-4e2f-b70e-f09e6e366055 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:25.177447 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ad90b2f9-ede9-4e2f-b70e-f09e6e366055 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:25.177885 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ad90b2f9-ede9-4e2f-b70e-f09e6e366055 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:25.280142 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-81f563bc-da3d-44cd-84dd-febcf478ad31 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 38134 microversion: 2.1 time: 0.149889 Aug 27 01:32:25.281041 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 222/423] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:32:25 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 38134 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:32:25.302495 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ad90b2f9-ede9-4e2f-b70e-f09e6e366055 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:25.310200 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-ad90b2f9-ede9-4e2f-b70e-f09e6e366055 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.146284 Aug 27 01:32:25.310761 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 202/424] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:25 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:26.007733 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-f25f967c-7da8-494d-ae90-14165b618e9f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:26.008679 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-f25f967c-7da8-494d-ae90-14165b618e9f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:26.015294 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f25f967c-7da8-494d-ae90-14165b618e9f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:26.015737 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f25f967c-7da8-494d-ae90-14165b618e9f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:26.017349 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f25f967c-7da8-494d-ae90-14165b618e9f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:26.017792 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f25f967c-7da8-494d-ae90-14165b618e9f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:26.179379 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-f25f967c-7da8-494d-ae90-14165b618e9f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 38025 microversion: 2.20 time: 0.175645 Aug 27 01:32:26.183658 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 223/425] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:32:26 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 38025 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:32:26.293180 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-18fcd0aa-400e-4aca-b797-a9a3d5644f55 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:26.294077 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-18fcd0aa-400e-4aca-b797-a9a3d5644f55 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:26.304394 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-18fcd0aa-400e-4aca-b797-a9a3d5644f55 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:26.304856 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-18fcd0aa-400e-4aca-b797-a9a3d5644f55 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:26.305648 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-18fcd0aa-400e-4aca-b797-a9a3d5644f55 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:26.306080 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-18fcd0aa-400e-4aca-b797-a9a3d5644f55 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:26.332305 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d1487000-f3d3-4725-8a54-9c14aeb71dd4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:26.333493 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d1487000-f3d3-4725-8a54-9c14aeb71dd4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:26.340911 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d1487000-f3d3-4725-8a54-9c14aeb71dd4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:26.347226 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d1487000-f3d3-4725-8a54-9c14aeb71dd4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:26.347226 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d1487000-f3d3-4725-8a54-9c14aeb71dd4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:26.347226 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d1487000-f3d3-4725-8a54-9c14aeb71dd4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:26.445061 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-18fcd0aa-400e-4aca-b797-a9a3d5644f55 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 200 len: 38252 microversion: 2.1 time: 0.156172 Aug 27 01:32:26.450541 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 203/426] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:32:26 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 38252 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:32:26.455785 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-66725182-2a4b-4ccf-b2ad-85f2cdec5e7c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:26.456346 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-66725182-2a4b-4ccf-b2ad-85f2cdec5e7c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:26.462888 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-66725182-2a4b-4ccf-b2ad-85f2cdec5e7c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:26.463327 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-66725182-2a4b-4ccf-b2ad-85f2cdec5e7c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:26.464112 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-66725182-2a4b-4ccf-b2ad-85f2cdec5e7c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:26.464539 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-66725182-2a4b-4ccf-b2ad-85f2cdec5e7c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:26.477831 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d1487000-f3d3-4725-8a54-9c14aeb71dd4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:26.486040 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d1487000-f3d3-4725-8a54-9c14aeb71dd4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.160350 Aug 27 01:32:26.486598 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 224/427] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:26 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:26.490032 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-66725182-2a4b-4ccf-b2ad-85f2cdec5e7c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/ips" status: 200 len: 145 microversion: 2.1 time: 0.037328 Aug 27 01:32:26.490032 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 204/428] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Aug 27 01:32:26 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:32:26.782127 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-12335dcb-a8f9-466a-b246-1860201465bd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2faff28-bb94-456d-8031-4f596438a16d"}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:26.782127 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-12335dcb-a8f9-466a-b246-1860201465bd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:26.787803 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-12335dcb-a8f9-466a-b246-1860201465bd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:26.788249 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-12335dcb-a8f9-466a-b246-1860201465bd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:26.789046 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-12335dcb-a8f9-466a-b246-1860201465bd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:26.789480 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-12335dcb-a8f9-466a-b246-1860201465bd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:27.191069 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-465a5d4e-a436-4ee2-a843-4cbba4369006 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:27.191988 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-465a5d4e-a436-4ee2-a843-4cbba4369006 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:27.198205 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-465a5d4e-a436-4ee2-a843-4cbba4369006 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:27.198551 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-465a5d4e-a436-4ee2-a843-4cbba4369006 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:27.199310 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-465a5d4e-a436-4ee2-a843-4cbba4369006 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:27.199736 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-465a5d4e-a436-4ee2-a843-4cbba4369006 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:27.334553 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-465a5d4e-a436-4ee2-a843-4cbba4369006 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 200 len: 38151 microversion: 2.20 time: 0.146996 Aug 27 01:32:27.335224 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 225/429] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:32:27 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 38151 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 01:32:27.346666 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-29f2ef94-1e86-4183-bb4b-bdc55293cab2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:27.346666 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-29f2ef94-1e86-4183-bb4b-bdc55293cab2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:27.352861 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-29f2ef94-1e86-4183-bb4b-bdc55293cab2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:27.353824 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-29f2ef94-1e86-4183-bb4b-bdc55293cab2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:27.354601 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-29f2ef94-1e86-4183-bb4b-bdc55293cab2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:27.355036 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-29f2ef94-1e86-4183-bb4b-bdc55293cab2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:27.379046 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-29f2ef94-1e86-4183-bb4b-bdc55293cab2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/ips" status: 200 len: 151 microversion: 2.20 time: 0.037356 Aug 27 01:32:27.379610 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 226/430] 10.222.0.25 () {60 vars in 1289 bytes} [Fri Aug 27 01:32:27 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:32:27.502952 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-7fd90387-b6bb-49b3-b6ac-512acc011ef2 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:27.509135 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-7fd90387-b6bb-49b3-b6ac-512acc011ef2 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:27.510534 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7fd90387-b6bb-49b3-b6ac-512acc011ef2 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:27.511143 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7fd90387-b6bb-49b3-b6ac-512acc011ef2 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:27.512194 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7fd90387-b6bb-49b3-b6ac-512acc011ef2 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:27.512776 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7fd90387-b6bb-49b3-b6ac-512acc011ef2 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:27.653701 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-7fd90387-b6bb-49b3-b6ac-512acc011ef2 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:27.661462 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-7fd90387-b6bb-49b3-b6ac-512acc011ef2 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.163000 Aug 27 01:32:27.665037 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 227/431] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:27 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:32:27.670040 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-12335dcb-a8f9-466a-b246-1860201465bd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "POST /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.892670 Aug 27 01:32:27.673688 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 205/432] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Aug 27 01:32:26 2021] POST /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments => generated 194 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:32:28.681582 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-0dd67abe-269b-4c43-9ebc-93f990f8d68e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:28.682189 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-0dd67abe-269b-4c43-9ebc-93f990f8d68e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:28.688260 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0dd67abe-269b-4c43-9ebc-93f990f8d68e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:28.688701 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0dd67abe-269b-4c43-9ebc-93f990f8d68e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:28.690068 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0dd67abe-269b-4c43-9ebc-93f990f8d68e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:28.690500 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0dd67abe-269b-4c43-9ebc-93f990f8d68e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:28.828288 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-0dd67abe-269b-4c43-9ebc-93f990f8d68e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:28.836604 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-0dd67abe-269b-4c43-9ebc-93f990f8d68e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.158813 Aug 27 01:32:28.837535 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 228/433] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:28 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:29.855092 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c94b4b71-9f27-422d-beaf-47dfc704f0f4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:29.855788 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c94b4b71-9f27-422d-beaf-47dfc704f0f4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:29.865113 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c94b4b71-9f27-422d-beaf-47dfc704f0f4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:29.865824 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c94b4b71-9f27-422d-beaf-47dfc704f0f4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:29.866846 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c94b4b71-9f27-422d-beaf-47dfc704f0f4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:29.867362 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c94b4b71-9f27-422d-beaf-47dfc704f0f4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:29.959761 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4f560527-24bd-4391-ba29-e388d80d4a5e tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "162671e3-424c-4947-a56f-f3f04a085f71"}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:29.961686 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4f560527-24bd-4391-ba29-e388d80d4a5e tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:29.967527 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4f560527-24bd-4391-ba29-e388d80d4a5e tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:29.968409 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4f560527-24bd-4391-ba29-e388d80d4a5e tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:29.969989 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4f560527-24bd-4391-ba29-e388d80d4a5e tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:29.970803 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4f560527-24bd-4391-ba29-e388d80d4a5e tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:30.020008 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c94b4b71-9f27-422d-beaf-47dfc704f0f4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:30.028175 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c94b4b71-9f27-422d-beaf-47dfc704f0f4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.176775 Aug 27 01:32:30.028500 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 206/434] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:29 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:30.713576 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4f560527-24bd-4391-ba29-e388d80d4a5e tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.757587 Aug 27 01:32:30.714201 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 229/435] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Aug 27 01:32:29 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/os-volume_attachments => generated 194 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:32:30.839379 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-58b3ed94-0e8d-47aa-8f6b-c7b37e183981 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:30.839979 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-58b3ed94-0e8d-47aa-8f6b-c7b37e183981 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:30.845855 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-58b3ed94-0e8d-47aa-8f6b-c7b37e183981 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:30.847692 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-58b3ed94-0e8d-47aa-8f6b-c7b37e183981 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:30.847938 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-58b3ed94-0e8d-47aa-8f6b-c7b37e183981 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:30.848377 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-58b3ed94-0e8d-47aa-8f6b-c7b37e183981 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:30.872341 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.objects.instance [None req-58b3ed94-0e8d-47aa-8f6b-c7b37e183981 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lazy-loading 'flavor' on Instance uuid 6ec83298-8a1e-4edd-be07-4e0592a0ce04 {{(pid=108756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:32:31.045858 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-3b118391-f73e-4e28-8ca7-ed547a502326 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:31.046843 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-3b118391-f73e-4e28-8ca7-ed547a502326 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:31.053330 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3b118391-f73e-4e28-8ca7-ed547a502326 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:31.053786 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3b118391-f73e-4e28-8ca7-ed547a502326 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:31.054551 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3b118391-f73e-4e28-8ca7-ed547a502326 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:31.054979 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3b118391-f73e-4e28-8ca7-ed547a502326 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:31.184294 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-3b118391-f73e-4e28-8ca7-ed547a502326 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:31.192412 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-3b118391-f73e-4e28-8ca7-ed547a502326 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.150704 Aug 27 01:32:31.193006 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 230/436] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:31 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:32:32.209366 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-3a5e416d-7c91-44d6-bcf7-479d0da3eec1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:32.210009 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-3a5e416d-7c91-44d6-bcf7-479d0da3eec1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:32.215771 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3a5e416d-7c91-44d6-bcf7-479d0da3eec1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:32.216213 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3a5e416d-7c91-44d6-bcf7-479d0da3eec1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:32.217000 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3a5e416d-7c91-44d6-bcf7-479d0da3eec1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:32.217429 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3a5e416d-7c91-44d6-bcf7-479d0da3eec1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:32.366355 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-3a5e416d-7c91-44d6-bcf7-479d0da3eec1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:32.373637 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-3a5e416d-7c91-44d6-bcf7-479d0da3eec1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.168507 Aug 27 01:32:32.374316 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 231/437] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:32 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:32:33.391399 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-28130119-bd7c-446b-8e9e-3e4b1dd8cc85 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:33.392043 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-28130119-bd7c-446b-8e9e-3e4b1dd8cc85 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:33.398261 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-28130119-bd7c-446b-8e9e-3e4b1dd8cc85 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:33.398705 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-28130119-bd7c-446b-8e9e-3e4b1dd8cc85 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:33.399467 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-28130119-bd7c-446b-8e9e-3e4b1dd8cc85 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:33.399893 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-28130119-bd7c-446b-8e9e-3e4b1dd8cc85 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:33.521247 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-28130119-bd7c-446b-8e9e-3e4b1dd8cc85 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:33.528288 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-28130119-bd7c-446b-8e9e-3e4b1dd8cc85 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.140755 Aug 27 01:32:33.528851 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 232/438] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:33 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:32:34.544821 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-f0f0f188-4a6b-428b-9651-6357c15e6b84 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:34.545431 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-f0f0f188-4a6b-428b-9651-6357c15e6b84 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:34.551640 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f0f0f188-4a6b-428b-9651-6357c15e6b84 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:34.552076 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f0f0f188-4a6b-428b-9651-6357c15e6b84 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:34.552824 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f0f0f188-4a6b-428b-9651-6357c15e6b84 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:34.553524 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f0f0f188-4a6b-428b-9651-6357c15e6b84 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:34.675695 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-f0f0f188-4a6b-428b-9651-6357c15e6b84 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:34.683299 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-f0f0f188-4a6b-428b-9651-6357c15e6b84 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.142099 Aug 27 01:32:34.686515 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 233/439] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:34 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:32:35.701212 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-e71d0b57-9195-4f95-aab8-ec104f694880 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:35.701903 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-e71d0b57-9195-4f95-aab8-ec104f694880 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:35.708151 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e71d0b57-9195-4f95-aab8-ec104f694880 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:35.712475 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e71d0b57-9195-4f95-aab8-ec104f694880 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:35.712475 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e71d0b57-9195-4f95-aab8-ec104f694880 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:35.712475 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e71d0b57-9195-4f95-aab8-ec104f694880 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:35.838323 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-e71d0b57-9195-4f95-aab8-ec104f694880 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:35.848093 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-e71d0b57-9195-4f95-aab8-ec104f694880 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.150427 Aug 27 01:32:35.850682 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 234/440] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:35 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:32:36.867545 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4a45f55f-42a1-4fe8-b753-1fa1315d1b99 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:36.868175 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4a45f55f-42a1-4fe8-b753-1fa1315d1b99 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:36.873955 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4a45f55f-42a1-4fe8-b753-1fa1315d1b99 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:36.874399 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4a45f55f-42a1-4fe8-b753-1fa1315d1b99 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:36.875162 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4a45f55f-42a1-4fe8-b753-1fa1315d1b99 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:36.875594 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4a45f55f-42a1-4fe8-b753-1fa1315d1b99 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:37.007803 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4a45f55f-42a1-4fe8-b753-1fa1315d1b99 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:37.015065 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4a45f55f-42a1-4fe8-b753-1fa1315d1b99 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.151373 Aug 27 01:32:37.015640 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 235/441] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:36 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:32:37.675112 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-dbfaa80c-8e3c-4cd4-98a0-994749645e21 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2faff28-bb94-456d-8031-4f596438a16d"}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:32:37.677036 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-dbfaa80c-8e3c-4cd4-98a0-994749645e21 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:37.688516 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-dbfaa80c-8e3c-4cd4-98a0-994749645e21 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:37.689073 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-dbfaa80c-8e3c-4cd4-98a0-994749645e21 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:37.694431 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-dbfaa80c-8e3c-4cd4-98a0-994749645e21 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:37.694431 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-dbfaa80c-8e3c-4cd4-98a0-994749645e21 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:37.777951 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.wsgi [None req-dbfaa80c-8e3c-4cd4-98a0-994749645e21 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] HTTP exception thrown: Invalid volume: volume e2faff28-bb94-456d-8031-4f596438a16d is already attached to instances: 5609c94a-0725-49da-a8dc-07496ea55d06 Aug 27 01:32:37.778556 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-dbfaa80c-8e3c-4cd4-98a0-994749645e21 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Returning 400 to user: Invalid volume: volume e2faff28-bb94-456d-8031-4f596438a16d is already attached to instances: 5609c94a-0725-49da-a8dc-07496ea55d06 {{(pid=108755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:32:37.779382 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-dbfaa80c-8e3c-4cd4-98a0-994749645e21 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "POST /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110456 Aug 27 01:32:37.779912 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 236/442] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Aug 27 01:32:37 2021] POST /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 01:32:37.845449 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-8a3ee721-f458-48d1-b33e-ccdd782518ea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:37.845943 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-8a3ee721-f458-48d1-b33e-ccdd782518ea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:37.852515 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8a3ee721-f458-48d1-b33e-ccdd782518ea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:37.854172 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8a3ee721-f458-48d1-b33e-ccdd782518ea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:37.854172 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8a3ee721-f458-48d1-b33e-ccdd782518ea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:37.854360 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8a3ee721-f458-48d1-b33e-ccdd782518ea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:37.939087 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.objects.instance [None req-8a3ee721-f458-48d1-b33e-ccdd782518ea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lazy-loading 'services' on Instance uuid 5609c94a-0725-49da-a8dc-07496ea55d06 {{(pid=108755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:32:38.142435 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-8a3ee721-f458-48d1-b33e-ccdd782518ea tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments/e2faff28-bb94-456d-8031-4f596438a16d" status: 202 len: 0 microversion: 2.1 time: 0.300640 Aug 27 01:32:38.143017 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 237/443] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Aug 27 01:32:37 2021] DELETE /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments/e2faff28-bb94-456d-8031-4f596438a16d => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 01:32:38.150448 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-80ca875b-8faf-4dc1-bf1d-21d2fe4d5400 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:38.151949 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-80ca875b-8faf-4dc1-bf1d-21d2fe4d5400 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:38.159580 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-80ca875b-8faf-4dc1-bf1d-21d2fe4d5400 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:38.160028 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-80ca875b-8faf-4dc1-bf1d-21d2fe4d5400 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:38.161356 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-80ca875b-8faf-4dc1-bf1d-21d2fe4d5400 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:38.161787 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-80ca875b-8faf-4dc1-bf1d-21d2fe4d5400 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:38.293328 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-80ca875b-8faf-4dc1-bf1d-21d2fe4d5400 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:38.300487 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-80ca875b-8faf-4dc1-bf1d-21d2fe4d5400 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.156366 Aug 27 01:32:38.301718 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 238/444] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:38 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:38.306374 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4b2fd32a-f056-409a-87b3-4beb739f1ced tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:38.311391 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4b2fd32a-f056-409a-87b3-4beb739f1ced tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:38.312765 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4b2fd32a-f056-409a-87b3-4beb739f1ced tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:38.313445 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4b2fd32a-f056-409a-87b3-4beb739f1ced tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:38.314350 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4b2fd32a-f056-409a-87b3-4beb739f1ced tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:38.314812 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4b2fd32a-f056-409a-87b3-4beb739f1ced tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:38.347000 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4b2fd32a-f056-409a-87b3-4beb739f1ced tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044269 Aug 27 01:32:38.347537 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 239/445] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:32:38 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:32:39.318477 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-90164ca1-294f-4858-81bd-ad5f85529111 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:39.319085 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-90164ca1-294f-4858-81bd-ad5f85529111 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:39.324822 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-90164ca1-294f-4858-81bd-ad5f85529111 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:39.325289 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-90164ca1-294f-4858-81bd-ad5f85529111 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:39.326039 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-90164ca1-294f-4858-81bd-ad5f85529111 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:39.326466 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-90164ca1-294f-4858-81bd-ad5f85529111 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:39.449325 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-90164ca1-294f-4858-81bd-ad5f85529111 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:39.456503 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-90164ca1-294f-4858-81bd-ad5f85529111 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.142409 Aug 27 01:32:39.457086 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 240/446] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:39 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:32:39.461347 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-2f9b0fa3-3ed5-42cb-929e-1b9278200dc8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:39.462229 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-2f9b0fa3-3ed5-42cb-929e-1b9278200dc8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:39.467584 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2f9b0fa3-3ed5-42cb-929e-1b9278200dc8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:39.468027 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2f9b0fa3-3ed5-42cb-929e-1b9278200dc8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:39.468775 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2f9b0fa3-3ed5-42cb-929e-1b9278200dc8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:39.469224 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2f9b0fa3-3ed5-42cb-929e-1b9278200dc8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:39.497974 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-2f9b0fa3-3ed5-42cb-929e-1b9278200dc8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039918 Aug 27 01:32:39.498512 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 241/447] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:32:39 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:32:40.472523 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-82fb60b6-947a-4efc-ba5a-1d891f8c20e8 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:40.473703 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-82fb60b6-947a-4efc-ba5a-1d891f8c20e8 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:40.479549 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-82fb60b6-947a-4efc-ba5a-1d891f8c20e8 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:40.479991 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-82fb60b6-947a-4efc-ba5a-1d891f8c20e8 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:40.480744 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-82fb60b6-947a-4efc-ba5a-1d891f8c20e8 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:40.481196 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-82fb60b6-947a-4efc-ba5a-1d891f8c20e8 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:40.598997 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-82fb60b6-947a-4efc-ba5a-1d891f8c20e8 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:40.606166 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-82fb60b6-947a-4efc-ba5a-1d891f8c20e8 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.137352 Aug 27 01:32:40.606712 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 242/448] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:40 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:32:40.610986 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-aa91f68a-ed3f-4765-a93e-0ba590b3e2f5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:40.611902 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-aa91f68a-ed3f-4765-a93e-0ba590b3e2f5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:40.618020 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-aa91f68a-ed3f-4765-a93e-0ba590b3e2f5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:40.618463 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-aa91f68a-ed3f-4765-a93e-0ba590b3e2f5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:40.619218 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-aa91f68a-ed3f-4765-a93e-0ba590b3e2f5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:40.619650 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-aa91f68a-ed3f-4765-a93e-0ba590b3e2f5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:40.647202 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-aa91f68a-ed3f-4765-a93e-0ba590b3e2f5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039528 Aug 27 01:32:40.647728 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 243/449] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:32:40 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:32:41.623846 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-a8efa1f0-a637-4bac-a044-6299edac7fa0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:41.624481 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-a8efa1f0-a637-4bac-a044-6299edac7fa0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:41.630621 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a8efa1f0-a637-4bac-a044-6299edac7fa0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:41.631064 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a8efa1f0-a637-4bac-a044-6299edac7fa0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:41.631812 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a8efa1f0-a637-4bac-a044-6299edac7fa0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:41.632241 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a8efa1f0-a637-4bac-a044-6299edac7fa0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:41.758443 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-a8efa1f0-a637-4bac-a044-6299edac7fa0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:41.766359 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-a8efa1f0-a637-4bac-a044-6299edac7fa0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.145783 Aug 27 01:32:41.773159 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 244/450] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:41 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:32:41.777805 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-0fdd7ac1-2b93-4a0d-b3b9-de724ea63da6 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:41.778738 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-0fdd7ac1-2b93-4a0d-b3b9-de724ea63da6 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:41.784483 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0fdd7ac1-2b93-4a0d-b3b9-de724ea63da6 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:41.784976 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0fdd7ac1-2b93-4a0d-b3b9-de724ea63da6 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:41.786378 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0fdd7ac1-2b93-4a0d-b3b9-de724ea63da6 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:41.786921 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0fdd7ac1-2b93-4a0d-b3b9-de724ea63da6 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:41.824381 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-0fdd7ac1-2b93-4a0d-b3b9-de724ea63da6 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050143 Aug 27 01:32:41.825217 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 245/451] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:32:41 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:32:42.783461 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-339b24ff-22ac-4657-be68-0e20a732cbdf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:42.784295 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-339b24ff-22ac-4657-be68-0e20a732cbdf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:42.791183 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-339b24ff-22ac-4657-be68-0e20a732cbdf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:42.791619 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-339b24ff-22ac-4657-be68-0e20a732cbdf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:42.792384 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-339b24ff-22ac-4657-be68-0e20a732cbdf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:42.792814 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-339b24ff-22ac-4657-be68-0e20a732cbdf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:42.920958 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-339b24ff-22ac-4657-be68-0e20a732cbdf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:42.929416 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-339b24ff-22ac-4657-be68-0e20a732cbdf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.149823 Aug 27 01:32:42.929969 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 246/452] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:42 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:42.934262 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-e56ad4f2-490e-4ce0-88d2-bf7c411bee5a tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:42.935145 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-e56ad4f2-490e-4ce0-88d2-bf7c411bee5a tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:42.941299 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e56ad4f2-490e-4ce0-88d2-bf7c411bee5a tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:42.942887 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e56ad4f2-490e-4ce0-88d2-bf7c411bee5a tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:42.944140 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e56ad4f2-490e-4ce0-88d2-bf7c411bee5a tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:42.944594 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e56ad4f2-490e-4ce0-88d2-bf7c411bee5a tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:42.978518 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-e56ad4f2-490e-4ce0-88d2-bf7c411bee5a tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047501 Aug 27 01:32:42.979078 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 247/453] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:32:42 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:32:43.947511 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-38ec722b-f533-436f-9293-6ca59bb2b6e1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:43.948181 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-38ec722b-f533-436f-9293-6ca59bb2b6e1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:43.954036 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-38ec722b-f533-436f-9293-6ca59bb2b6e1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:43.954701 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-38ec722b-f533-436f-9293-6ca59bb2b6e1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:43.955474 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-38ec722b-f533-436f-9293-6ca59bb2b6e1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:43.955902 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-38ec722b-f533-436f-9293-6ca59bb2b6e1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:44.081378 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-38ec722b-f533-436f-9293-6ca59bb2b6e1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:44.089318 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-38ec722b-f533-436f-9293-6ca59bb2b6e1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.145426 Aug 27 01:32:44.089878 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 248/454] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:43 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:32:44.094231 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4997162d-faca-42fc-b226-8089b21974bb tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:44.095201 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4997162d-faca-42fc-b226-8089b21974bb tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:44.101159 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4997162d-faca-42fc-b226-8089b21974bb tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:44.101604 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4997162d-faca-42fc-b226-8089b21974bb tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:44.102359 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4997162d-faca-42fc-b226-8089b21974bb tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:44.102792 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4997162d-faca-42fc-b226-8089b21974bb tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:44.132810 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4997162d-faca-42fc-b226-8089b21974bb tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041872 Aug 27 01:32:44.133402 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 249/455] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:32:44 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:32:45.106371 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-9e4ed031-b6d0-49d0-94d9-06ad8a567d0b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:45.107036 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-9e4ed031-b6d0-49d0-94d9-06ad8a567d0b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:45.112721 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9e4ed031-b6d0-49d0-94d9-06ad8a567d0b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:45.113195 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9e4ed031-b6d0-49d0-94d9-06ad8a567d0b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:45.114008 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9e4ed031-b6d0-49d0-94d9-06ad8a567d0b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:45.114441 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9e4ed031-b6d0-49d0-94d9-06ad8a567d0b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:45.243913 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-9e4ed031-b6d0-49d0-94d9-06ad8a567d0b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:45.251049 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-9e4ed031-b6d0-49d0-94d9-06ad8a567d0b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.148329 Aug 27 01:32:45.251597 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 250/456] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:45 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:32:45.256457 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-1f6c7005-e721-48c1-97aa-242e8e61eb4d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:45.257366 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-1f6c7005-e721-48c1-97aa-242e8e61eb4d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:45.262693 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1f6c7005-e721-48c1-97aa-242e8e61eb4d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:45.263126 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1f6c7005-e721-48c1-97aa-242e8e61eb4d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:45.264029 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1f6c7005-e721-48c1-97aa-242e8e61eb4d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:45.264468 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1f6c7005-e721-48c1-97aa-242e8e61eb4d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:45.299969 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-1f6c7005-e721-48c1-97aa-242e8e61eb4d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047333 Aug 27 01:32:45.300530 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 251/457] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:32:45 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:32:46.269199 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-89d08279-edbd-44a2-89fb-93fcbfdae0d0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:46.269814 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-89d08279-edbd-44a2-89fb-93fcbfdae0d0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:46.276734 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-89d08279-edbd-44a2-89fb-93fcbfdae0d0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:46.277210 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-89d08279-edbd-44a2-89fb-93fcbfdae0d0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:46.277965 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-89d08279-edbd-44a2-89fb-93fcbfdae0d0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:46.278392 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-89d08279-edbd-44a2-89fb-93fcbfdae0d0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:46.424605 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-89d08279-edbd-44a2-89fb-93fcbfdae0d0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:46.433531 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-89d08279-edbd-44a2-89fb-93fcbfdae0d0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.168020 Aug 27 01:32:46.434101 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 252/458] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:46 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:32:46.438685 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-ebea888f-412e-4745-921a-9461d4b765ef tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:46.439590 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-ebea888f-412e-4745-921a-9461d4b765ef tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:46.445928 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ebea888f-412e-4745-921a-9461d4b765ef tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:46.446377 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ebea888f-412e-4745-921a-9461d4b765ef tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:46.447138 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ebea888f-412e-4745-921a-9461d4b765ef tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:46.447573 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ebea888f-412e-4745-921a-9461d4b765ef tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:46.477176 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-ebea888f-412e-4745-921a-9461d4b765ef tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042068 Aug 27 01:32:46.477712 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 253/459] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:32:46 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:32:47.450736 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-138b8913-88ef-44c0-987e-8d253d26ca6b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:47.451251 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-138b8913-88ef-44c0-987e-8d253d26ca6b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:47.457004 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-138b8913-88ef-44c0-987e-8d253d26ca6b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:47.457452 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-138b8913-88ef-44c0-987e-8d253d26ca6b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:47.458218 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-138b8913-88ef-44c0-987e-8d253d26ca6b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:47.458655 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-138b8913-88ef-44c0-987e-8d253d26ca6b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:47.592659 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-138b8913-88ef-44c0-987e-8d253d26ca6b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:47.601951 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-138b8913-88ef-44c0-987e-8d253d26ca6b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.154952 Aug 27 01:32:47.602880 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 254/460] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:47 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:32:47.607613 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-61b5e00b-71b2-4b06-95af-8ec34fdd87f8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:47.608604 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-61b5e00b-71b2-4b06-95af-8ec34fdd87f8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:47.614722 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-61b5e00b-71b2-4b06-95af-8ec34fdd87f8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:47.615278 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-61b5e00b-71b2-4b06-95af-8ec34fdd87f8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:47.616125 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-61b5e00b-71b2-4b06-95af-8ec34fdd87f8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:47.616561 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-61b5e00b-71b2-4b06-95af-8ec34fdd87f8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:47.645932 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-61b5e00b-71b2-4b06-95af-8ec34fdd87f8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041702 Aug 27 01:32:47.647260 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 255/461] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:32:47 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:32:48.619110 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4958d2f6-3df1-4a44-a773-8444d1bb1a01 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:48.619739 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4958d2f6-3df1-4a44-a773-8444d1bb1a01 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:48.625533 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4958d2f6-3df1-4a44-a773-8444d1bb1a01 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:48.625970 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4958d2f6-3df1-4a44-a773-8444d1bb1a01 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:48.626721 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4958d2f6-3df1-4a44-a773-8444d1bb1a01 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:48.627146 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4958d2f6-3df1-4a44-a773-8444d1bb1a01 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:48.753180 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4958d2f6-3df1-4a44-a773-8444d1bb1a01 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:48.760342 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4958d2f6-3df1-4a44-a773-8444d1bb1a01 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.145428 Aug 27 01:32:48.760906 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 256/462] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:48 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:32:48.765211 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d606e79e-075e-4be5-bfa8-c36acfc20b96 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:48.766098 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d606e79e-075e-4be5-bfa8-c36acfc20b96 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:48.771519 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d606e79e-075e-4be5-bfa8-c36acfc20b96 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:48.772115 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d606e79e-075e-4be5-bfa8-c36acfc20b96 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:48.772805 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d606e79e-075e-4be5-bfa8-c36acfc20b96 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:48.773264 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d606e79e-075e-4be5-bfa8-c36acfc20b96 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:48.801546 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d606e79e-075e-4be5-bfa8-c36acfc20b96 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039646 Aug 27 01:32:48.808722 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 257/463] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:32:48 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:32:49.253436 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-58b3ed94-0e8d-47aa-8f6b-c7b37e183981 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 202 len: 0 microversion: 2.20 time: 18.417964 Aug 27 01:32:49.254023 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 207/464] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:32:30 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 0 bytes in 18419 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 01:32:49.265314 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-6a0c346e-cbb4-4bd7-96eb-01776885410c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:49.265939 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-6a0c346e-cbb4-4bd7-96eb-01776885410c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:49.273107 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6a0c346e-cbb4-4bd7-96eb-01776885410c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:49.273563 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6a0c346e-cbb4-4bd7-96eb-01776885410c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:49.274344 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6a0c346e-cbb4-4bd7-96eb-01776885410c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:49.274779 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6a0c346e-cbb4-4bd7-96eb-01776885410c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:49.406167 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-6a0c346e-cbb4-4bd7-96eb-01776885410c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:49.414482 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-6a0c346e-cbb4-4bd7-96eb-01776885410c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:49.415980 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-6a0c346e-cbb4-4bd7-96eb-01776885410c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:49.417166 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-6a0c346e-cbb4-4bd7-96eb-01776885410c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1722 microversion: 2.20 time: 0.158237 Aug 27 01:32:49.417705 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 258/465] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:32:49 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:32:49.778214 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-55641cc2-65fd-49bc-81f5-da8ca6791abf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:49.778905 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-55641cc2-65fd-49bc-81f5-da8ca6791abf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:49.785099 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-55641cc2-65fd-49bc-81f5-da8ca6791abf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:49.785627 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-55641cc2-65fd-49bc-81f5-da8ca6791abf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:49.786573 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-55641cc2-65fd-49bc-81f5-da8ca6791abf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:49.787632 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-55641cc2-65fd-49bc-81f5-da8ca6791abf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:49.817886 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-1cc7c67e-1a80-4998-8663-f5152714f1a9 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:49.818876 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-1cc7c67e-1a80-4998-8663-f5152714f1a9 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:49.839035 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1cc7c67e-1a80-4998-8663-f5152714f1a9 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:49.844999 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1cc7c67e-1a80-4998-8663-f5152714f1a9 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:49.844999 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1cc7c67e-1a80-4998-8663-f5152714f1a9 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:49.844999 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1cc7c67e-1a80-4998-8663-f5152714f1a9 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:49.875703 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-1cc7c67e-1a80-4998-8663-f5152714f1a9 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061424 Aug 27 01:32:49.876352 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 259/466] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:32:49 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:32:49.911472 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-55641cc2-65fd-49bc-81f5-da8ca6791abf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:49.919068 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-55641cc2-65fd-49bc-81f5-da8ca6791abf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.144857 Aug 27 01:32:49.919802 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 208/467] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:49 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:50.437494 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-a4684465-1830-4ac8-8e08-1517bae84e09 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:50.438092 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-a4684465-1830-4ac8-8e08-1517bae84e09 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:50.443961 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a4684465-1830-4ac8-8e08-1517bae84e09 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:50.444404 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a4684465-1830-4ac8-8e08-1517bae84e09 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:50.445183 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a4684465-1830-4ac8-8e08-1517bae84e09 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:50.445612 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a4684465-1830-4ac8-8e08-1517bae84e09 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:50.575134 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-a4684465-1830-4ac8-8e08-1517bae84e09 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:50.583398 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-a4684465-1830-4ac8-8e08-1517bae84e09 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:50.585575 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-a4684465-1830-4ac8-8e08-1517bae84e09 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:50.586750 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-a4684465-1830-4ac8-8e08-1517bae84e09 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1722 microversion: 2.20 time: 0.152924 Aug 27 01:32:50.587482 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 260/468] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:32:50 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:32:50.887493 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-79c22c6e-d513-48c9-958d-8d6ea4710082 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:50.888452 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-79c22c6e-d513-48c9-958d-8d6ea4710082 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:50.894313 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-79c22c6e-d513-48c9-958d-8d6ea4710082 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:50.894755 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-79c22c6e-d513-48c9-958d-8d6ea4710082 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:50.895510 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-79c22c6e-d513-48c9-958d-8d6ea4710082 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:50.895939 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-79c22c6e-d513-48c9-958d-8d6ea4710082 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:50.924448 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-79c22c6e-d513-48c9-958d-8d6ea4710082 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040689 Aug 27 01:32:50.925011 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 209/469] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:32:50 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:32:50.936336 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-a55b5ca9-5073-4830-8e87-f943e9864239 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:50.936985 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-a55b5ca9-5073-4830-8e87-f943e9864239 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:50.942687 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a55b5ca9-5073-4830-8e87-f943e9864239 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:50.944113 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a55b5ca9-5073-4830-8e87-f943e9864239 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:50.944458 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a55b5ca9-5073-4830-8e87-f943e9864239 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:50.944921 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a55b5ca9-5073-4830-8e87-f943e9864239 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:51.070780 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-a55b5ca9-5073-4830-8e87-f943e9864239 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:51.077928 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-a55b5ca9-5073-4830-8e87-f943e9864239 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.145141 Aug 27 01:32:51.078470 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 261/470] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:50 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:51.605374 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-fbce4dfe-74aa-4a26-b696-af43ffbe7982 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:51.605971 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-fbce4dfe-74aa-4a26-b696-af43ffbe7982 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:51.611609 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fbce4dfe-74aa-4a26-b696-af43ffbe7982 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:51.612041 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fbce4dfe-74aa-4a26-b696-af43ffbe7982 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:51.612853 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fbce4dfe-74aa-4a26-b696-af43ffbe7982 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:51.613388 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fbce4dfe-74aa-4a26-b696-af43ffbe7982 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:51.730427 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-fbce4dfe-74aa-4a26-b696-af43ffbe7982 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:51.738072 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-fbce4dfe-74aa-4a26-b696-af43ffbe7982 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:51.739569 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-fbce4dfe-74aa-4a26-b696-af43ffbe7982 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:51.741526 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-fbce4dfe-74aa-4a26-b696-af43ffbe7982 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1722 microversion: 2.20 time: 0.139623 Aug 27 01:32:51.742079 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 210/471] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:32:51 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1722 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:32:51.935230 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-208e9317-43df-4676-bd03-7d551b9facd2 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:51.936141 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-208e9317-43df-4676-bd03-7d551b9facd2 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:51.941869 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-208e9317-43df-4676-bd03-7d551b9facd2 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:51.942435 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-208e9317-43df-4676-bd03-7d551b9facd2 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:51.943086 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-208e9317-43df-4676-bd03-7d551b9facd2 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:51.943501 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-208e9317-43df-4676-bd03-7d551b9facd2 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:51.971745 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-208e9317-43df-4676-bd03-7d551b9facd2 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040199 Aug 27 01:32:51.972277 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 262/472] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:32:51 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:32:52.098513 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-0c38a332-191a-4bdc-9ae0-f24dff5340c9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:52.099099 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-0c38a332-191a-4bdc-9ae0-f24dff5340c9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:52.113808 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0c38a332-191a-4bdc-9ae0-f24dff5340c9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:52.113808 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0c38a332-191a-4bdc-9ae0-f24dff5340c9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:52.113808 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0c38a332-191a-4bdc-9ae0-f24dff5340c9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:52.113808 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0c38a332-191a-4bdc-9ae0-f24dff5340c9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:52.235552 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0c38a332-191a-4bdc-9ae0-f24dff5340c9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:52.243388 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-0c38a332-191a-4bdc-9ae0-f24dff5340c9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.151833 Aug 27 01:32:52.243950 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 211/473] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:52 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:52.759608 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-91cd5093-de83-4070-bf0b-3d7f0b9ccdf9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:52.760209 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-91cd5093-de83-4070-bf0b-3d7f0b9ccdf9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:52.765987 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-91cd5093-de83-4070-bf0b-3d7f0b9ccdf9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:52.766432 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-91cd5093-de83-4070-bf0b-3d7f0b9ccdf9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:52.767187 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-91cd5093-de83-4070-bf0b-3d7f0b9ccdf9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:52.767617 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-91cd5093-de83-4070-bf0b-3d7f0b9ccdf9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:52.889031 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-91cd5093-de83-4070-bf0b-3d7f0b9ccdf9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:52.897011 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-91cd5093-de83-4070-bf0b-3d7f0b9ccdf9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:52.898609 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-91cd5093-de83-4070-bf0b-3d7f0b9ccdf9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:52.899737 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-91cd5093-de83-4070-bf0b-3d7f0b9ccdf9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1722 microversion: 2.20 time: 0.144389 Aug 27 01:32:52.900336 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 263/474] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:32:52 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1722 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:32:52.983797 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-3c89a7db-c5f4-4869-b367-aae19b90c5c4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:52.984706 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-3c89a7db-c5f4-4869-b367-aae19b90c5c4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:52.990555 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3c89a7db-c5f4-4869-b367-aae19b90c5c4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:52.990990 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3c89a7db-c5f4-4869-b367-aae19b90c5c4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:52.991743 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3c89a7db-c5f4-4869-b367-aae19b90c5c4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:52.992201 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3c89a7db-c5f4-4869-b367-aae19b90c5c4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:53.020444 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-3c89a7db-c5f4-4869-b367-aae19b90c5c4 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040762 Aug 27 01:32:53.021036 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 212/475] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:32:52 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:32:53.259864 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-25910473-7b06-47f9-8f95-61faaeadf49f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:53.260427 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-25910473-7b06-47f9-8f95-61faaeadf49f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:53.266333 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-25910473-7b06-47f9-8f95-61faaeadf49f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:53.266790 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-25910473-7b06-47f9-8f95-61faaeadf49f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:53.270528 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-25910473-7b06-47f9-8f95-61faaeadf49f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:53.270528 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-25910473-7b06-47f9-8f95-61faaeadf49f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:53.399340 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-25910473-7b06-47f9-8f95-61faaeadf49f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:53.406974 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-25910473-7b06-47f9-8f95-61faaeadf49f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.151361 Aug 27 01:32:53.407518 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 264/476] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:53 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:53.917539 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-45ed1ea8-35e9-43b4-9b0a-77fdce8e8f59 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:53.918135 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-45ed1ea8-35e9-43b4-9b0a-77fdce8e8f59 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:53.923914 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-45ed1ea8-35e9-43b4-9b0a-77fdce8e8f59 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:53.924354 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-45ed1ea8-35e9-43b4-9b0a-77fdce8e8f59 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:53.925137 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-45ed1ea8-35e9-43b4-9b0a-77fdce8e8f59 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:53.925565 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-45ed1ea8-35e9-43b4-9b0a-77fdce8e8f59 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:54.039896 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d8a385e4-9ac9-4ff8-af05-0cf92000d4da tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:54.041916 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d8a385e4-9ac9-4ff8-af05-0cf92000d4da tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:54.049168 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d8a385e4-9ac9-4ff8-af05-0cf92000d4da tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:54.053047 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-45ed1ea8-35e9-43b4-9b0a-77fdce8e8f59 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:54.056307 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d8a385e4-9ac9-4ff8-af05-0cf92000d4da tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:54.057189 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d8a385e4-9ac9-4ff8-af05-0cf92000d4da tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:54.057632 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d8a385e4-9ac9-4ff8-af05-0cf92000d4da tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:54.064080 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-45ed1ea8-35e9-43b4-9b0a-77fdce8e8f59 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:54.065779 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-45ed1ea8-35e9-43b4-9b0a-77fdce8e8f59 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:54.066921 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-45ed1ea8-35e9-43b4-9b0a-77fdce8e8f59 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1722 microversion: 2.20 time: 0.153089 Aug 27 01:32:54.067782 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 213/477] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:32:53 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:32:54.098774 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d8a385e4-9ac9-4ff8-af05-0cf92000d4da tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063192 Aug 27 01:32:54.099329 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 265/478] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:32:54 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:32:54.424710 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-b8a17490-6a61-4dc1-8afb-01f24e7b440b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:54.425352 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-b8a17490-6a61-4dc1-8afb-01f24e7b440b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:54.433088 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b8a17490-6a61-4dc1-8afb-01f24e7b440b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:54.433540 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b8a17490-6a61-4dc1-8afb-01f24e7b440b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:54.434318 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b8a17490-6a61-4dc1-8afb-01f24e7b440b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:54.434754 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b8a17490-6a61-4dc1-8afb-01f24e7b440b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:54.559209 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-b8a17490-6a61-4dc1-8afb-01f24e7b440b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:54.566448 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-b8a17490-6a61-4dc1-8afb-01f24e7b440b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.145553 Aug 27 01:32:54.566997 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 214/479] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:54 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:55.086366 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-2c99803d-114e-4f93-8cfe-35542e9afe4b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:55.087044 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-2c99803d-114e-4f93-8cfe-35542e9afe4b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:55.093029 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2c99803d-114e-4f93-8cfe-35542e9afe4b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:55.093471 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2c99803d-114e-4f93-8cfe-35542e9afe4b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:55.094295 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2c99803d-114e-4f93-8cfe-35542e9afe4b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:55.094785 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2c99803d-114e-4f93-8cfe-35542e9afe4b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:55.110621 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-96fa8b5f-88f3-4a87-9285-36c89fd1a463 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:55.111593 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-96fa8b5f-88f3-4a87-9285-36c89fd1a463 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:55.117456 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-96fa8b5f-88f3-4a87-9285-36c89fd1a463 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:55.117943 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-96fa8b5f-88f3-4a87-9285-36c89fd1a463 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:55.118724 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-96fa8b5f-88f3-4a87-9285-36c89fd1a463 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:55.119153 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-96fa8b5f-88f3-4a87-9285-36c89fd1a463 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:55.149402 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-96fa8b5f-88f3-4a87-9285-36c89fd1a463 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042450 Aug 27 01:32:55.149963 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 215/480] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:32:55 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:32:55.220277 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-2c99803d-114e-4f93-8cfe-35542e9afe4b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:55.228763 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-2c99803d-114e-4f93-8cfe-35542e9afe4b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:55.230331 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-2c99803d-114e-4f93-8cfe-35542e9afe4b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:55.231501 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-2c99803d-114e-4f93-8cfe-35542e9afe4b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1722 microversion: 2.20 time: 0.149401 Aug 27 01:32:55.232054 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 266/481] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:32:55 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:32:55.582846 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-fdf38f1d-7436-42f8-be52-ba34765c2de9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:55.583481 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-fdf38f1d-7436-42f8-be52-ba34765c2de9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:55.590616 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fdf38f1d-7436-42f8-be52-ba34765c2de9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:55.591059 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fdf38f1d-7436-42f8-be52-ba34765c2de9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:55.591833 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fdf38f1d-7436-42f8-be52-ba34765c2de9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:55.592261 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fdf38f1d-7436-42f8-be52-ba34765c2de9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:55.715861 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-fdf38f1d-7436-42f8-be52-ba34765c2de9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:55.727258 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-fdf38f1d-7436-42f8-be52-ba34765c2de9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.148003 Aug 27 01:32:55.728378 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 216/482] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:55 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:56.160718 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b0de92ec-9782-4210-b573-0cefa699607e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:56.161646 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b0de92ec-9782-4210-b573-0cefa699607e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:56.168136 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b0de92ec-9782-4210-b573-0cefa699607e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:56.168574 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b0de92ec-9782-4210-b573-0cefa699607e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:56.169353 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b0de92ec-9782-4210-b573-0cefa699607e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:56.169783 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b0de92ec-9782-4210-b573-0cefa699607e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:56.198448 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b0de92ec-9782-4210-b573-0cefa699607e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041391 Aug 27 01:32:56.198914 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 267/483] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:32:56 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:32:56.249102 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-94b15076-249c-4c3f-9b4e-a91d63977fac tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:56.249701 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-94b15076-249c-4c3f-9b4e-a91d63977fac tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:56.255423 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-94b15076-249c-4c3f-9b4e-a91d63977fac tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:56.255858 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-94b15076-249c-4c3f-9b4e-a91d63977fac tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:56.256608 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-94b15076-249c-4c3f-9b4e-a91d63977fac tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:56.257064 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-94b15076-249c-4c3f-9b4e-a91d63977fac tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:56.376881 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-94b15076-249c-4c3f-9b4e-a91d63977fac tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:56.385627 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-94b15076-249c-4c3f-9b4e-a91d63977fac tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:56.387121 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-94b15076-249c-4c3f-9b4e-a91d63977fac tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:56.388250 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-94b15076-249c-4c3f-9b4e-a91d63977fac tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1722 microversion: 2.20 time: 0.142840 Aug 27 01:32:56.388809 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 217/484] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:32:56 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1722 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:32:56.743205 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-f950a25c-f07e-46ac-9e78-7322ed1eb97f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:56.743840 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-f950a25c-f07e-46ac-9e78-7322ed1eb97f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:56.749605 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f950a25c-f07e-46ac-9e78-7322ed1eb97f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:56.750050 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f950a25c-f07e-46ac-9e78-7322ed1eb97f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:56.750813 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f950a25c-f07e-46ac-9e78-7322ed1eb97f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:56.751251 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f950a25c-f07e-46ac-9e78-7322ed1eb97f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:56.884243 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-f950a25c-f07e-46ac-9e78-7322ed1eb97f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:56.888524 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-f950a25c-f07e-46ac-9e78-7322ed1eb97f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.149008 Aug 27 01:32:56.889157 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 268/485] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:56 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:57.209385 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-37f4e0f0-681b-43f2-80bb-f07dbc6a93bd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:57.210286 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-37f4e0f0-681b-43f2-80bb-f07dbc6a93bd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:57.216693 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-37f4e0f0-681b-43f2-80bb-f07dbc6a93bd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:57.217164 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-37f4e0f0-681b-43f2-80bb-f07dbc6a93bd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:57.217925 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-37f4e0f0-681b-43f2-80bb-f07dbc6a93bd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:57.218361 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-37f4e0f0-681b-43f2-80bb-f07dbc6a93bd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:57.248329 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-37f4e0f0-681b-43f2-80bb-f07dbc6a93bd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042616 Aug 27 01:32:57.248905 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 218/486] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:32:57 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:32:57.406296 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-87d43a32-9c4a-41ad-a15b-3cfb13b2ba6c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:57.407044 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-87d43a32-9c4a-41ad-a15b-3cfb13b2ba6c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:57.413532 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-87d43a32-9c4a-41ad-a15b-3cfb13b2ba6c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:57.416396 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-87d43a32-9c4a-41ad-a15b-3cfb13b2ba6c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:57.416396 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-87d43a32-9c4a-41ad-a15b-3cfb13b2ba6c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:57.416396 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-87d43a32-9c4a-41ad-a15b-3cfb13b2ba6c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:57.541684 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-87d43a32-9c4a-41ad-a15b-3cfb13b2ba6c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:57.549428 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-87d43a32-9c4a-41ad-a15b-3cfb13b2ba6c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:57.551036 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-87d43a32-9c4a-41ad-a15b-3cfb13b2ba6c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:57.552277 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-87d43a32-9c4a-41ad-a15b-3cfb13b2ba6c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1722 microversion: 2.20 time: 0.150088 Aug 27 01:32:57.553204 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 269/487] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:32:57 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:32:57.905237 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-246a34ba-cabb-4803-b43c-de434ad03b71 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:57.905895 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-246a34ba-cabb-4803-b43c-de434ad03b71 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:57.911960 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-246a34ba-cabb-4803-b43c-de434ad03b71 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:57.912405 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-246a34ba-cabb-4803-b43c-de434ad03b71 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:57.913200 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-246a34ba-cabb-4803-b43c-de434ad03b71 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:57.913639 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-246a34ba-cabb-4803-b43c-de434ad03b71 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:58.049325 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-246a34ba-cabb-4803-b43c-de434ad03b71 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:58.057584 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-246a34ba-cabb-4803-b43c-de434ad03b71 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.156233 Aug 27 01:32:58.058164 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 219/488] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:57 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:58.259736 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-3cafb39b-07d7-467f-8798-0a2085ad1052 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:58.260643 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-3cafb39b-07d7-467f-8798-0a2085ad1052 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:58.266429 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3cafb39b-07d7-467f-8798-0a2085ad1052 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:58.266879 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3cafb39b-07d7-467f-8798-0a2085ad1052 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:58.267638 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3cafb39b-07d7-467f-8798-0a2085ad1052 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:58.268066 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3cafb39b-07d7-467f-8798-0a2085ad1052 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:58.297100 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-3cafb39b-07d7-467f-8798-0a2085ad1052 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041193 Aug 27 01:32:58.297652 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 270/489] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:32:58 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:32:58.571346 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-6637a6c6-4cd8-4d5a-bc5f-cee7809c1a9d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:58.572062 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-6637a6c6-4cd8-4d5a-bc5f-cee7809c1a9d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:58.578123 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6637a6c6-4cd8-4d5a-bc5f-cee7809c1a9d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:58.578582 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6637a6c6-4cd8-4d5a-bc5f-cee7809c1a9d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:58.579344 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6637a6c6-4cd8-4d5a-bc5f-cee7809c1a9d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:58.579785 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6637a6c6-4cd8-4d5a-bc5f-cee7809c1a9d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:58.706867 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-6637a6c6-4cd8-4d5a-bc5f-cee7809c1a9d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:58.716546 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-6637a6c6-4cd8-4d5a-bc5f-cee7809c1a9d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:58.718731 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-6637a6c6-4cd8-4d5a-bc5f-cee7809c1a9d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:58.720089 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-6637a6c6-4cd8-4d5a-bc5f-cee7809c1a9d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1722 microversion: 2.20 time: 0.153149 Aug 27 01:32:58.721341 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 220/490] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:32:58 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:32:59.074818 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-8f00c3b4-f6f8-4d07-babf-0e7754d9cdcc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:59.076035 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-8f00c3b4-f6f8-4d07-babf-0e7754d9cdcc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:59.082337 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8f00c3b4-f6f8-4d07-babf-0e7754d9cdcc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:59.082879 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8f00c3b4-f6f8-4d07-babf-0e7754d9cdcc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:59.083728 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8f00c3b4-f6f8-4d07-babf-0e7754d9cdcc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:59.084244 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8f00c3b4-f6f8-4d07-babf-0e7754d9cdcc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:59.216008 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-8f00c3b4-f6f8-4d07-babf-0e7754d9cdcc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:59.224429 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-8f00c3b4-f6f8-4d07-babf-0e7754d9cdcc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.152393 Aug 27 01:32:59.224429 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 271/491] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:32:59 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:32:59.312913 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-07efe361-8228-4234-a2c5-e54b33901499 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:59.313834 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-07efe361-8228-4234-a2c5-e54b33901499 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:59.328995 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-07efe361-8228-4234-a2c5-e54b33901499 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:59.329441 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-07efe361-8228-4234-a2c5-e54b33901499 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:59.330210 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-07efe361-8228-4234-a2c5-e54b33901499 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:59.330636 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-07efe361-8228-4234-a2c5-e54b33901499 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:59.365314 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-07efe361-8228-4234-a2c5-e54b33901499 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056056 Aug 27 01:32:59.365949 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 221/492] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:32:59 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:32:59.739427 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-ee2161e7-ecc7-497d-aa9c-605eaf0416d0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:32:59.740509 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-ee2161e7-ecc7-497d-aa9c-605eaf0416d0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:32:59.749728 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ee2161e7-ecc7-497d-aa9c-605eaf0416d0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:59.750239 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ee2161e7-ecc7-497d-aa9c-605eaf0416d0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:59.751065 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ee2161e7-ecc7-497d-aa9c-605eaf0416d0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:32:59.751873 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ee2161e7-ecc7-497d-aa9c-605eaf0416d0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:32:59.884448 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-ee2161e7-ecc7-497d-aa9c-605eaf0416d0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:59.892611 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-ee2161e7-ecc7-497d-aa9c-605eaf0416d0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:59.894146 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-ee2161e7-ecc7-497d-aa9c-605eaf0416d0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:32:59.895338 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-ee2161e7-ecc7-497d-aa9c-605eaf0416d0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1722 microversion: 2.20 time: 0.159633 Aug 27 01:32:59.895874 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 272/493] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:32:59 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:00.240675 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-af9c754f-9ed5-4670-818c-aa50bcb51dc1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:00.241227 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-af9c754f-9ed5-4670-818c-aa50bcb51dc1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:00.248355 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-af9c754f-9ed5-4670-818c-aa50bcb51dc1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:00.248795 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-af9c754f-9ed5-4670-818c-aa50bcb51dc1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:00.249636 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-af9c754f-9ed5-4670-818c-aa50bcb51dc1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:00.250059 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-af9c754f-9ed5-4670-818c-aa50bcb51dc1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:00.377087 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-a4092e60-4788-476d-aa72-d165c7e73f68 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:00.378556 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-a4092e60-4788-476d-aa72-d165c7e73f68 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:00.385530 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a4092e60-4788-476d-aa72-d165c7e73f68 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:00.386238 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a4092e60-4788-476d-aa72-d165c7e73f68 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:00.387011 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a4092e60-4788-476d-aa72-d165c7e73f68 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:00.387447 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a4092e60-4788-476d-aa72-d165c7e73f68 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:00.396721 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-af9c754f-9ed5-4670-818c-aa50bcb51dc1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:00.404923 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-af9c754f-9ed5-4670-818c-aa50bcb51dc1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.168055 Aug 27 01:33:00.405658 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 222/494] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:00 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:33:00.432989 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-a4092e60-4788-476d-aa72-d165c7e73f68 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059738 Aug 27 01:33:00.433554 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 273/495] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:33:00 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:33:00.915211 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c5d315da-7bbd-4951-8f50-7882e7f22be0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:00.915818 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c5d315da-7bbd-4951-8f50-7882e7f22be0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:00.921601 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c5d315da-7bbd-4951-8f50-7882e7f22be0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:00.922043 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c5d315da-7bbd-4951-8f50-7882e7f22be0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:00.922803 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c5d315da-7bbd-4951-8f50-7882e7f22be0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:00.923234 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c5d315da-7bbd-4951-8f50-7882e7f22be0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:01.043329 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c5d315da-7bbd-4951-8f50-7882e7f22be0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:01.051044 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c5d315da-7bbd-4951-8f50-7882e7f22be0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:01.052810 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c5d315da-7bbd-4951-8f50-7882e7f22be0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:01.053966 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c5d315da-7bbd-4951-8f50-7882e7f22be0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1722 microversion: 2.20 time: 0.143232 Aug 27 01:33:01.054662 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 223/496] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:00 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1722 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:01.424564 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-1d7ca6ae-f4cb-4997-9560-1386fcc593f5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:01.425381 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-1d7ca6ae-f4cb-4997-9560-1386fcc593f5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:01.432222 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1d7ca6ae-f4cb-4997-9560-1386fcc593f5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:01.432689 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1d7ca6ae-f4cb-4997-9560-1386fcc593f5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:01.433496 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1d7ca6ae-f4cb-4997-9560-1386fcc593f5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:01.433930 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1d7ca6ae-f4cb-4997-9560-1386fcc593f5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:01.443724 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-1e31999d-e314-4b7b-888e-82e91b8b58cc tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:01.445923 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-1e31999d-e314-4b7b-888e-82e91b8b58cc tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:01.455887 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1e31999d-e314-4b7b-888e-82e91b8b58cc tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:01.455887 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1e31999d-e314-4b7b-888e-82e91b8b58cc tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:01.455887 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1e31999d-e314-4b7b-888e-82e91b8b58cc tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:01.455887 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1e31999d-e314-4b7b-888e-82e91b8b58cc tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:01.500573 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-1e31999d-e314-4b7b-888e-82e91b8b58cc tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060431 Aug 27 01:33:01.501170 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 224/497] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:33:01 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:33:01.595430 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-1d7ca6ae-f4cb-4997-9560-1386fcc593f5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:01.603798 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-1d7ca6ae-f4cb-4997-9560-1386fcc593f5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.185240 Aug 27 01:33:01.604391 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 274/498] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:01 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:02.072083 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-8214e204-7caa-4d6a-bbf0-33e0474d28c2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:02.072961 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-8214e204-7caa-4d6a-bbf0-33e0474d28c2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:02.081358 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8214e204-7caa-4d6a-bbf0-33e0474d28c2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:02.082072 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8214e204-7caa-4d6a-bbf0-33e0474d28c2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:02.083046 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8214e204-7caa-4d6a-bbf0-33e0474d28c2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:02.083718 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8214e204-7caa-4d6a-bbf0-33e0474d28c2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:02.190815 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-9c828168-903e-4bb0-b394-940fcdfb9400 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:33:02.200372 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9c828168-903e-4bb0-b394-940fcdfb9400 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:02.200896 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9c828168-903e-4bb0-b394-940fcdfb9400 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:02.239040 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-8214e204-7caa-4d6a-bbf0-33e0474d28c2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:02.247223 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-8214e204-7caa-4d6a-bbf0-33e0474d28c2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:02.249203 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-8214e204-7caa-4d6a-bbf0-33e0474d28c2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:02.254298 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-8214e204-7caa-4d6a-bbf0-33e0474d28c2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1722 microversion: 2.20 time: 0.185544 Aug 27 01:33:02.266188 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 225/499] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:02 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:02.309594 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-9c828168-903e-4bb0-b394-940fcdfb9400 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Going to try to stop instance {{(pid=108755) force_stop /opt/stack/nova/nova/compute/api.py:2615}} Aug 27 01:33:02.505395 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-9c828168-903e-4bb0-b394-940fcdfb9400 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 202 len: 0 microversion: 2.1 time: 0.317978 Aug 27 01:33:02.507732 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 275/500] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:33:02 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:33:02.512208 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-46d2c57a-e9bd-4b0e-ad63-4119bde8a081 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:02.513156 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-46d2c57a-e9bd-4b0e-ad63-4119bde8a081 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:02.516664 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-f8183ebb-a14a-495f-aa39-5c54b8723beb tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:02.517386 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-f8183ebb-a14a-495f-aa39-5c54b8723beb tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:02.520169 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-46d2c57a-e9bd-4b0e-ad63-4119bde8a081 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:02.520658 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-46d2c57a-e9bd-4b0e-ad63-4119bde8a081 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:02.521750 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-46d2c57a-e9bd-4b0e-ad63-4119bde8a081 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:02.522540 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-46d2c57a-e9bd-4b0e-ad63-4119bde8a081 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:02.524526 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f8183ebb-a14a-495f-aa39-5c54b8723beb tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:02.525014 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f8183ebb-a14a-495f-aa39-5c54b8723beb tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:02.525790 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f8183ebb-a14a-495f-aa39-5c54b8723beb tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:02.526225 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f8183ebb-a14a-495f-aa39-5c54b8723beb tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:02.557894 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-46d2c57a-e9bd-4b0e-ad63-4119bde8a081 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050399 Aug 27 01:33:02.558479 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 226/501] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:33:02 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:33:02.627857 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-a6352120-8960-4a89-a2e6-967b5c145519 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:02.629610 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-a6352120-8960-4a89-a2e6-967b5c145519 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:02.636530 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a6352120-8960-4a89-a2e6-967b5c145519 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:02.642039 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a6352120-8960-4a89-a2e6-967b5c145519 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:02.642039 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a6352120-8960-4a89-a2e6-967b5c145519 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:02.642039 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a6352120-8960-4a89-a2e6-967b5c145519 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:02.672084 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-f8183ebb-a14a-495f-aa39-5c54b8723beb tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:02.687116 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-f8183ebb-a14a-495f-aa39-5c54b8723beb tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1722 microversion: 2.1 time: 0.174283 Aug 27 01:33:02.687881 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 276/502] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:02 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:33:02.775041 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-a6352120-8960-4a89-a2e6-967b5c145519 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:02.782193 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-a6352120-8960-4a89-a2e6-967b5c145519 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.164406 Aug 27 01:33:02.782747 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 227/503] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:02 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:33:03.272736 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-5072a247-6f5e-4c81-a1aa-71c52aab796c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:03.273857 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-5072a247-6f5e-4c81-a1aa-71c52aab796c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:03.279872 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5072a247-6f5e-4c81-a1aa-71c52aab796c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:03.280320 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5072a247-6f5e-4c81-a1aa-71c52aab796c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:03.281116 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5072a247-6f5e-4c81-a1aa-71c52aab796c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:03.281585 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5072a247-6f5e-4c81-a1aa-71c52aab796c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:03.407161 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-5072a247-6f5e-4c81-a1aa-71c52aab796c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:03.414874 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-5072a247-6f5e-4c81-a1aa-71c52aab796c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:03.416389 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-5072a247-6f5e-4c81-a1aa-71c52aab796c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:03.417569 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-5072a247-6f5e-4c81-a1aa-71c52aab796c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1722 microversion: 2.20 time: 0.148595 Aug 27 01:33:03.418120 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 277/504] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:03 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:03.569398 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-b073eb20-b830-4952-acf2-a203a667a43c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:03.570858 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-b073eb20-b830-4952-acf2-a203a667a43c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:03.576602 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b073eb20-b830-4952-acf2-a203a667a43c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:03.577080 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b073eb20-b830-4952-acf2-a203a667a43c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:03.577861 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b073eb20-b830-4952-acf2-a203a667a43c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:03.578288 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b073eb20-b830-4952-acf2-a203a667a43c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:03.606441 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-b073eb20-b830-4952-acf2-a203a667a43c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040811 Aug 27 01:33:03.606971 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 228/505] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:33:03 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:33:03.703788 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-f6fd77e1-9f6a-4969-9152-858f57b3377d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:03.704395 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-f6fd77e1-9f6a-4969-9152-858f57b3377d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:03.710213 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f6fd77e1-9f6a-4969-9152-858f57b3377d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:03.711255 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f6fd77e1-9f6a-4969-9152-858f57b3377d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:03.712036 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f6fd77e1-9f6a-4969-9152-858f57b3377d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:03.712454 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f6fd77e1-9f6a-4969-9152-858f57b3377d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:03.798726 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-3679a5de-b21a-4d12-a70c-401d7a47dd55 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:03.799333 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-3679a5de-b21a-4d12-a70c-401d7a47dd55 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:03.805533 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3679a5de-b21a-4d12-a70c-401d7a47dd55 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:03.807412 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3679a5de-b21a-4d12-a70c-401d7a47dd55 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:03.807412 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3679a5de-b21a-4d12-a70c-401d7a47dd55 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:03.807412 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3679a5de-b21a-4d12-a70c-401d7a47dd55 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:03.830233 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-f6fd77e1-9f6a-4969-9152-858f57b3377d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:03.839079 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-f6fd77e1-9f6a-4969-9152-858f57b3377d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1722 microversion: 2.1 time: 0.138844 Aug 27 01:33:03.844368 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 278/506] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:03 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1722 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:03.929108 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-3679a5de-b21a-4d12-a70c-401d7a47dd55 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:03.937034 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-3679a5de-b21a-4d12-a70c-401d7a47dd55 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.141814 Aug 27 01:33:03.937586 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 229/507] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:03 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:33:04.437470 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-aaaec479-6721-41fb-84a3-e4785ef70d91 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:04.438213 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-aaaec479-6721-41fb-84a3-e4785ef70d91 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:04.444280 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-aaaec479-6721-41fb-84a3-e4785ef70d91 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:04.444666 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-aaaec479-6721-41fb-84a3-e4785ef70d91 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:04.445686 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-aaaec479-6721-41fb-84a3-e4785ef70d91 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:04.446118 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-aaaec479-6721-41fb-84a3-e4785ef70d91 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:04.574635 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-aaaec479-6721-41fb-84a3-e4785ef70d91 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:04.582244 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-aaaec479-6721-41fb-84a3-e4785ef70d91 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:04.583735 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-aaaec479-6721-41fb-84a3-e4785ef70d91 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:04.584868 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-aaaec479-6721-41fb-84a3-e4785ef70d91 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1722 microversion: 2.20 time: 0.152278 Aug 27 01:33:04.585416 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 279/508] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:04 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:04.618082 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-a3d00600-385a-4366-87ab-693fa0c2ff86 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:04.618993 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-a3d00600-385a-4366-87ab-693fa0c2ff86 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:04.624876 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a3d00600-385a-4366-87ab-693fa0c2ff86 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:04.625318 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a3d00600-385a-4366-87ab-693fa0c2ff86 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:04.626076 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a3d00600-385a-4366-87ab-693fa0c2ff86 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:04.626506 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a3d00600-385a-4366-87ab-693fa0c2ff86 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:04.655116 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-a3d00600-385a-4366-87ab-693fa0c2ff86 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041299 Aug 27 01:33:04.655650 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 230/509] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:33:04 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:33:04.856526 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-cd0aa9c5-dc18-475c-b916-78ef1a5a402b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:04.857078 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-cd0aa9c5-dc18-475c-b916-78ef1a5a402b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:04.862988 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-cd0aa9c5-dc18-475c-b916-78ef1a5a402b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:04.863493 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-cd0aa9c5-dc18-475c-b916-78ef1a5a402b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:04.864161 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-cd0aa9c5-dc18-475c-b916-78ef1a5a402b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:04.864591 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-cd0aa9c5-dc18-475c-b916-78ef1a5a402b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:04.954501 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-3b179955-1b5f-46b7-8c61-0fa4893557c5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:04.955221 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-3b179955-1b5f-46b7-8c61-0fa4893557c5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:04.961517 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3b179955-1b5f-46b7-8c61-0fa4893557c5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:04.962046 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3b179955-1b5f-46b7-8c61-0fa4893557c5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:04.962811 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3b179955-1b5f-46b7-8c61-0fa4893557c5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:04.963268 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3b179955-1b5f-46b7-8c61-0fa4893557c5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:05.027974 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-cd0aa9c5-dc18-475c-b916-78ef1a5a402b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:05.035881 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-cd0aa9c5-dc18-475c-b916-78ef1a5a402b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1722 microversion: 2.1 time: 0.183039 Aug 27 01:33:05.036437 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 280/510] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:04 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:05.082508 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-3b179955-1b5f-46b7-8c61-0fa4893557c5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:05.090369 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-3b179955-1b5f-46b7-8c61-0fa4893557c5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.139666 Aug 27 01:33:05.090923 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 231/511] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:04 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:33:05.604236 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-c0bf0281-2612-443b-aeec-dd7975cb082a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:05.604865 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-c0bf0281-2612-443b-aeec-dd7975cb082a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:05.610567 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c0bf0281-2612-443b-aeec-dd7975cb082a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:05.612928 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c0bf0281-2612-443b-aeec-dd7975cb082a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:05.612928 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c0bf0281-2612-443b-aeec-dd7975cb082a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:05.612928 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c0bf0281-2612-443b-aeec-dd7975cb082a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:05.666707 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-9f71de56-4c7a-4f42-9eae-b58e73478663 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:05.667626 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-9f71de56-4c7a-4f42-9eae-b58e73478663 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:05.673474 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9f71de56-4c7a-4f42-9eae-b58e73478663 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:05.673927 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9f71de56-4c7a-4f42-9eae-b58e73478663 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:05.674697 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9f71de56-4c7a-4f42-9eae-b58e73478663 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:05.675135 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9f71de56-4c7a-4f42-9eae-b58e73478663 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:05.704278 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-9f71de56-4c7a-4f42-9eae-b58e73478663 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041958 Aug 27 01:33:05.704915 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 232/512] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:33:05 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 01:33:05.734392 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-c0bf0281-2612-443b-aeec-dd7975cb082a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:05.742302 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-c0bf0281-2612-443b-aeec-dd7975cb082a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:05.743994 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-c0bf0281-2612-443b-aeec-dd7975cb082a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:05.745154 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-c0bf0281-2612-443b-aeec-dd7975cb082a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1722 microversion: 2.20 time: 0.145246 Aug 27 01:33:05.750634 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 281/513] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:05 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1722 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:05.918835 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-733a03b4-3ea8-4ab6-aa60-32eee60e2041 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-700629993", "imageRef": "6660bea6-dee9-43b4-95ef-29b53e1a2b28", "flavorRef": "452", "networks": [{"uuid": "0794f498-7c79-4c04-9426-97a5145b6e4e"}]}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:33:05.969784 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.network.neutron [None req-733a03b4-3ea8-4ab6-aa60-32eee60e2041 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] validate_networks() for [('0794f498-7c79-4c04-9426-97a5145b6e4e', None, None, None, None, None)] {{(pid=108756) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 01:33:06.053087 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d9e7d05c-5e3d-4750-8dbe-3a512a5c6d47 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:06.053696 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d9e7d05c-5e3d-4750-8dbe-3a512a5c6d47 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:06.059890 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d9e7d05c-5e3d-4750-8dbe-3a512a5c6d47 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:06.060339 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d9e7d05c-5e3d-4750-8dbe-3a512a5c6d47 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:06.061138 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d9e7d05c-5e3d-4750-8dbe-3a512a5c6d47 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:06.061573 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d9e7d05c-5e3d-4750-8dbe-3a512a5c6d47 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:06.190568 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d9e7d05c-5e3d-4750-8dbe-3a512a5c6d47 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:06.199119 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d9e7d05c-5e3d-4750-8dbe-3a512a5c6d47 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1722 microversion: 2.1 time: 0.150055 Aug 27 01:33:06.199684 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 282/514] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:06 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:33:06.204024 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-f77669e2-a783-4335-b4ca-4605709a7a3e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:06.204654 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-f77669e2-a783-4335-b4ca-4605709a7a3e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:06.210405 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f77669e2-a783-4335-b4ca-4605709a7a3e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:06.210879 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f77669e2-a783-4335-b4ca-4605709a7a3e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:06.211640 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f77669e2-a783-4335-b4ca-4605709a7a3e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:06.212071 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f77669e2-a783-4335-b4ca-4605709a7a3e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:06.339934 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-f77669e2-a783-4335-b4ca-4605709a7a3e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:06.341999 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-733a03b4-3ea8-4ab6-aa60-32eee60e2041 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Flavor limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 01:33:06.342475 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-733a03b4-3ea8-4ab6-aa60-32eee60e2041 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Image limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 01:33:06.342945 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-733a03b4-3ea8-4ab6-aa60-32eee60e2041 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Flavor pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 01:33:06.343353 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-733a03b4-3ea8-4ab6-aa60-32eee60e2041 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Image pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 01:33:06.343760 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-733a03b4-3ea8-4ab6-aa60-32eee60e2041 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 01:33:06.349969 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-f77669e2-a783-4335-b4ca-4605709a7a3e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.149287 Aug 27 01:33:06.350766 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 283/515] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:06 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:06.357176 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-733a03b4-3ea8-4ab6-aa60-32eee60e2041 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:06.357870 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-733a03b4-3ea8-4ab6-aa60-32eee60e2041 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:06.358672 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-733a03b4-3ea8-4ab6-aa60-32eee60e2041 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:06.359097 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-733a03b4-3ea8-4ab6-aa60-32eee60e2041 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:06.376764 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-733a03b4-3ea8-4ab6-aa60-32eee60e2041 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Getting quotas for project 8c9439f7236d4228aea4ccc73e5d6c08. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:33:06.382543 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-733a03b4-3ea8-4ab6-aa60-32eee60e2041 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Getting quotas for user 589eca6a184e4505a0c0f97efe65892e and project 8c9439f7236d4228aea4ccc73e5d6c08. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:33:06.397479 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-733a03b4-3ea8-4ab6-aa60-32eee60e2041 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Going to run 1 instances... {{(pid=108756) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 01:33:06.400738 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-733a03b4-3ea8-4ab6-aa60-32eee60e2041 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6660bea6-dee9-43b4-95ef-29b53e1a2b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 01:33:06.538056 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-733a03b4-3ea8-4ab6-aa60-32eee60e2041 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.622867 Aug 27 01:33:06.538864 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 233/516] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Aug 27 01:33:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 01:33:06.548245 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-14768171-dbd8-48ae-bd6c-926a48cfbe83 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:06.548880 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-14768171-dbd8-48ae-bd6c-926a48cfbe83 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:06.617130 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-14768171-dbd8-48ae-bd6c-926a48cfbe83 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:06.634746 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-14768171-dbd8-48ae-bd6c-926a48cfbe83 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1217 microversion: 2.1 time: 0.090040 Aug 27 01:33:06.635464 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 284/517] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:06 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:06.767215 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-72fbe97c-e5c4-4020-afb6-b550096eec17 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:06.767911 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-72fbe97c-e5c4-4020-afb6-b550096eec17 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:06.774596 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-72fbe97c-e5c4-4020-afb6-b550096eec17 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:06.775043 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-72fbe97c-e5c4-4020-afb6-b550096eec17 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:06.775810 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-72fbe97c-e5c4-4020-afb6-b550096eec17 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:06.776239 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-72fbe97c-e5c4-4020-afb6-b550096eec17 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:06.906817 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-72fbe97c-e5c4-4020-afb6-b550096eec17 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:06.914519 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-72fbe97c-e5c4-4020-afb6-b550096eec17 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:06.916019 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-72fbe97c-e5c4-4020-afb6-b550096eec17 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:06.917243 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-72fbe97c-e5c4-4020-afb6-b550096eec17 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1722 microversion: 2.20 time: 0.153696 Aug 27 01:33:06.917737 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 234/518] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:06 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:07.215287 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-927f2e33-8aaa-45f1-99cc-51a99f7a5c64 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:07.215891 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-927f2e33-8aaa-45f1-99cc-51a99f7a5c64 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:07.221622 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-927f2e33-8aaa-45f1-99cc-51a99f7a5c64 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:07.222067 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-927f2e33-8aaa-45f1-99cc-51a99f7a5c64 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:07.222822 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-927f2e33-8aaa-45f1-99cc-51a99f7a5c64 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:07.223249 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-927f2e33-8aaa-45f1-99cc-51a99f7a5c64 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:07.343020 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-927f2e33-8aaa-45f1-99cc-51a99f7a5c64 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:07.350938 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-927f2e33-8aaa-45f1-99cc-51a99f7a5c64 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1722 microversion: 2.1 time: 0.139318 Aug 27 01:33:07.352057 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 285/519] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:07 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1722 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:07.367740 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-7975aa1a-faea-49c8-bb45-10e28aadf6bd tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:07.368277 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-7975aa1a-faea-49c8-bb45-10e28aadf6bd tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:07.374042 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7975aa1a-faea-49c8-bb45-10e28aadf6bd tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:07.374480 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7975aa1a-faea-49c8-bb45-10e28aadf6bd tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:07.375227 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7975aa1a-faea-49c8-bb45-10e28aadf6bd tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:07.375655 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7975aa1a-faea-49c8-bb45-10e28aadf6bd tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:07.496515 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-7975aa1a-faea-49c8-bb45-10e28aadf6bd tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:07.503889 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-7975aa1a-faea-49c8-bb45-10e28aadf6bd tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.140391 Aug 27 01:33:07.504655 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 235/520] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:07 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:07.651110 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-0d09b719-5107-441e-825d-9d29de138744 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:07.651717 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-0d09b719-5107-441e-825d-9d29de138744 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:07.657587 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0d09b719-5107-441e-825d-9d29de138744 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:07.658501 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0d09b719-5107-441e-825d-9d29de138744 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:07.658856 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0d09b719-5107-441e-825d-9d29de138744 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:07.659274 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0d09b719-5107-441e-825d-9d29de138744 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:07.719274 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-0d09b719-5107-441e-825d-9d29de138744 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:07.727308 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-0d09b719-5107-441e-825d-9d29de138744 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1221 microversion: 2.1 time: 0.078995 Aug 27 01:33:07.727849 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 286/521] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:07 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:07.935606 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-2dfe62b5-a2f4-499c-a1ac-2e9c40a8d5c3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:07.936216 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-2dfe62b5-a2f4-499c-a1ac-2e9c40a8d5c3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:07.942243 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2dfe62b5-a2f4-499c-a1ac-2e9c40a8d5c3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:07.942692 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2dfe62b5-a2f4-499c-a1ac-2e9c40a8d5c3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:07.943463 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2dfe62b5-a2f4-499c-a1ac-2e9c40a8d5c3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:07.943897 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2dfe62b5-a2f4-499c-a1ac-2e9c40a8d5c3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:08.067551 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-2dfe62b5-a2f4-499c-a1ac-2e9c40a8d5c3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:08.075504 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-2dfe62b5-a2f4-499c-a1ac-2e9c40a8d5c3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:08.077087 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-2dfe62b5-a2f4-499c-a1ac-2e9c40a8d5c3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:08.078223 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-2dfe62b5-a2f4-499c-a1ac-2e9c40a8d5c3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1722 microversion: 2.20 time: 0.146372 Aug 27 01:33:08.078772 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 236/522] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:07 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:08.367212 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-01fec447-382f-453d-9ede-ed2bdc2b733b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:08.367724 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-01fec447-382f-453d-9ede-ed2bdc2b733b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:08.374663 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-01fec447-382f-453d-9ede-ed2bdc2b733b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:08.375103 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-01fec447-382f-453d-9ede-ed2bdc2b733b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:08.375859 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-01fec447-382f-453d-9ede-ed2bdc2b733b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:08.376284 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-01fec447-382f-453d-9ede-ed2bdc2b733b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:08.496244 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-01fec447-382f-453d-9ede-ed2bdc2b733b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:08.503782 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-01fec447-382f-453d-9ede-ed2bdc2b733b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1722 microversion: 2.1 time: 0.140365 Aug 27 01:33:08.504334 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 287/523] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:08 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1722 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:08.520940 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-6b7b34ee-c4d9-451a-a3ab-7c73d52c1910 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:08.521547 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-6b7b34ee-c4d9-451a-a3ab-7c73d52c1910 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:08.527238 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6b7b34ee-c4d9-451a-a3ab-7c73d52c1910 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:08.527685 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6b7b34ee-c4d9-451a-a3ab-7c73d52c1910 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:08.528443 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6b7b34ee-c4d9-451a-a3ab-7c73d52c1910 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:08.528898 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6b7b34ee-c4d9-451a-a3ab-7c73d52c1910 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:08.645973 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-6b7b34ee-c4d9-451a-a3ab-7c73d52c1910 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:08.653631 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-6b7b34ee-c4d9-451a-a3ab-7c73d52c1910 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.136242 Aug 27 01:33:08.654195 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 237/524] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:08 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:08.744473 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-af572a22-32d4-469c-af9c-f6bd3f7e5193 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:08.745100 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-af572a22-32d4-469c-af9c-f6bd3f7e5193 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:08.750761 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-af572a22-32d4-469c-af9c-f6bd3f7e5193 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:08.751200 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-af572a22-32d4-469c-af9c-f6bd3f7e5193 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:08.751945 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-af572a22-32d4-469c-af9c-f6bd3f7e5193 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:08.752371 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-af572a22-32d4-469c-af9c-f6bd3f7e5193 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:08.812359 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-af572a22-32d4-469c-af9c-f6bd3f7e5193 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:08.819619 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-af572a22-32d4-469c-af9c-f6bd3f7e5193 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1221 microversion: 2.1 time: 0.079352 Aug 27 01:33:08.820166 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 288/525] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:08 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:09.096234 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-7ac218af-8e38-4299-a2d7-e3f69ed7d565 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:09.096794 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-7ac218af-8e38-4299-a2d7-e3f69ed7d565 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:09.103281 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7ac218af-8e38-4299-a2d7-e3f69ed7d565 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:09.103729 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7ac218af-8e38-4299-a2d7-e3f69ed7d565 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:09.104483 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7ac218af-8e38-4299-a2d7-e3f69ed7d565 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:09.104942 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7ac218af-8e38-4299-a2d7-e3f69ed7d565 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:09.224364 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-7ac218af-8e38-4299-a2d7-e3f69ed7d565 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:09.232774 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-7ac218af-8e38-4299-a2d7-e3f69ed7d565 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:09.234290 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-7ac218af-8e38-4299-a2d7-e3f69ed7d565 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:09.235407 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-7ac218af-8e38-4299-a2d7-e3f69ed7d565 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1722 microversion: 2.20 time: 0.143024 Aug 27 01:33:09.235948 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 238/526] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:09 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1722 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:09.521359 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-e96954c9-50e6-4f0d-8f70-0174a3d4b1ed tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:09.521960 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-e96954c9-50e6-4f0d-8f70-0174a3d4b1ed tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:09.528392 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e96954c9-50e6-4f0d-8f70-0174a3d4b1ed tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:09.528847 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e96954c9-50e6-4f0d-8f70-0174a3d4b1ed tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:09.529602 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e96954c9-50e6-4f0d-8f70-0174a3d4b1ed tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:09.530027 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e96954c9-50e6-4f0d-8f70-0174a3d4b1ed tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:09.649006 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-e96954c9-50e6-4f0d-8f70-0174a3d4b1ed tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:09.657485 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-e96954c9-50e6-4f0d-8f70-0174a3d4b1ed tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1722 microversion: 2.1 time: 0.139720 Aug 27 01:33:09.658053 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 289/527] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:09 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1722 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:09.672204 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-719a6394-815a-41fa-933b-d6ac5a958120 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:09.672204 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-719a6394-815a-41fa-933b-d6ac5a958120 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:09.676549 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-719a6394-815a-41fa-933b-d6ac5a958120 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:09.677304 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-719a6394-815a-41fa-933b-d6ac5a958120 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:09.678072 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-719a6394-815a-41fa-933b-d6ac5a958120 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:09.678510 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-719a6394-815a-41fa-933b-d6ac5a958120 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:09.799041 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-719a6394-815a-41fa-933b-d6ac5a958120 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:09.806571 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-719a6394-815a-41fa-933b-d6ac5a958120 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.140187 Aug 27 01:33:09.809607 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 239/528] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:09 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:09.835322 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-0ec2ff81-b181-444f-891c-60f7e2a92075 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:09.837413 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-0ec2ff81-b181-444f-891c-60f7e2a92075 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:09.842380 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0ec2ff81-b181-444f-891c-60f7e2a92075 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:09.842874 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0ec2ff81-b181-444f-891c-60f7e2a92075 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:09.843599 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0ec2ff81-b181-444f-891c-60f7e2a92075 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:09.844024 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0ec2ff81-b181-444f-891c-60f7e2a92075 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:09.901915 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-0ec2ff81-b181-444f-891c-60f7e2a92075 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:09.908905 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-0ec2ff81-b181-444f-891c-60f7e2a92075 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1221 microversion: 2.1 time: 0.077130 Aug 27 01:33:09.909455 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 290/529] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:09 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1221 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:10.252818 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-16d43e58-be8a-4efc-a40e-b266b0545fd1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:10.253435 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-16d43e58-be8a-4efc-a40e-b266b0545fd1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:10.259885 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-16d43e58-be8a-4efc-a40e-b266b0545fd1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:10.260321 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-16d43e58-be8a-4efc-a40e-b266b0545fd1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:10.261101 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-16d43e58-be8a-4efc-a40e-b266b0545fd1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:10.261531 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-16d43e58-be8a-4efc-a40e-b266b0545fd1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:10.387914 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-16d43e58-be8a-4efc-a40e-b266b0545fd1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:10.395609 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-16d43e58-be8a-4efc-a40e-b266b0545fd1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:10.397221 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-16d43e58-be8a-4efc-a40e-b266b0545fd1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:10.398358 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-16d43e58-be8a-4efc-a40e-b266b0545fd1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1722 microversion: 2.20 time: 0.149138 Aug 27 01:33:10.398909 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 240/530] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:10 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:10.680270 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-a3bc06c1-aee8-42b4-a002-8a2d309351dd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:10.680924 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-a3bc06c1-aee8-42b4-a002-8a2d309351dd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:10.687074 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a3bc06c1-aee8-42b4-a002-8a2d309351dd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:10.687520 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a3bc06c1-aee8-42b4-a002-8a2d309351dd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:10.688426 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a3bc06c1-aee8-42b4-a002-8a2d309351dd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:10.688874 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a3bc06c1-aee8-42b4-a002-8a2d309351dd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:10.825374 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-8c6a132f-a7c6-4ea5-8268-39f29bb8967c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:10.826249 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-8c6a132f-a7c6-4ea5-8268-39f29bb8967c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:10.832682 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8c6a132f-a7c6-4ea5-8268-39f29bb8967c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:10.833176 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8c6a132f-a7c6-4ea5-8268-39f29bb8967c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:10.833968 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8c6a132f-a7c6-4ea5-8268-39f29bb8967c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:10.834410 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8c6a132f-a7c6-4ea5-8268-39f29bb8967c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:10.834719 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-a3bc06c1-aee8-42b4-a002-8a2d309351dd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:10.844706 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-a3bc06c1-aee8-42b4-a002-8a2d309351dd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1722 microversion: 2.1 time: 0.173270 Aug 27 01:33:10.851307 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 291/531] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:10 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:10.929062 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-035341da-c122-4777-a72f-a9bdcb334237 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:10.935218 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-035341da-c122-4777-a72f-a9bdcb334237 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:10.937415 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-035341da-c122-4777-a72f-a9bdcb334237 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:10.938098 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-035341da-c122-4777-a72f-a9bdcb334237 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:10.938960 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-035341da-c122-4777-a72f-a9bdcb334237 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:10.939461 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-035341da-c122-4777-a72f-a9bdcb334237 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:10.974215 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-8c6a132f-a7c6-4ea5-8268-39f29bb8967c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:10.982642 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-8c6a132f-a7c6-4ea5-8268-39f29bb8967c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.161568 Aug 27 01:33:10.987838 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 241/532] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:10 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:11.017172 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-035341da-c122-4777-a72f-a9bdcb334237 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:11.028709 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-035341da-c122-4777-a72f-a9bdcb334237 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1213 microversion: 2.1 time: 0.106692 Aug 27 01:33:11.029719 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 292/533] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:10 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1213 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:33:11.419155 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-662ed57e-cb4c-46c5-81c8-40a6dfa5ae41 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:11.419760 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-662ed57e-cb4c-46c5-81c8-40a6dfa5ae41 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:11.425645 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-662ed57e-cb4c-46c5-81c8-40a6dfa5ae41 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:11.426097 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-662ed57e-cb4c-46c5-81c8-40a6dfa5ae41 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:11.426885 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-662ed57e-cb4c-46c5-81c8-40a6dfa5ae41 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:11.427579 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-662ed57e-cb4c-46c5-81c8-40a6dfa5ae41 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:11.549571 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-662ed57e-cb4c-46c5-81c8-40a6dfa5ae41 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:11.558824 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-662ed57e-cb4c-46c5-81c8-40a6dfa5ae41 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:11.560328 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-662ed57e-cb4c-46c5-81c8-40a6dfa5ae41 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:11.561506 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-662ed57e-cb4c-46c5-81c8-40a6dfa5ae41 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1722 microversion: 2.20 time: 0.146235 Aug 27 01:33:11.562155 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 242/534] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:11 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:11.863582 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-1e1eaa90-7756-407b-9e7d-9ab19d135b74 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:11.864189 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-1e1eaa90-7756-407b-9e7d-9ab19d135b74 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:11.871209 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1e1eaa90-7756-407b-9e7d-9ab19d135b74 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:11.877184 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1e1eaa90-7756-407b-9e7d-9ab19d135b74 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:11.877184 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1e1eaa90-7756-407b-9e7d-9ab19d135b74 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:11.877184 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1e1eaa90-7756-407b-9e7d-9ab19d135b74 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:12.007001 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-17bd6e11-c39f-4424-a6ac-0fd5efd837b9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:12.007942 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-17bd6e11-c39f-4424-a6ac-0fd5efd837b9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:12.016205 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-17bd6e11-c39f-4424-a6ac-0fd5efd837b9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:12.016205 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-17bd6e11-c39f-4424-a6ac-0fd5efd837b9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:12.017372 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-17bd6e11-c39f-4424-a6ac-0fd5efd837b9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:12.018013 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-17bd6e11-c39f-4424-a6ac-0fd5efd837b9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:12.104436 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-1e1eaa90-7756-407b-9e7d-9ab19d135b74 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:12.112959 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-1e1eaa90-7756-407b-9e7d-9ab19d135b74 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1722 microversion: 2.1 time: 0.253264 Aug 27 01:33:12.116596 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 293/535] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:11 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:12.119071 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-27a10fef-2acd-4855-b4fa-604821313f9f tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:12.119832 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-27a10fef-2acd-4855-b4fa-604821313f9f tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:12.126355 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-27a10fef-2acd-4855-b4fa-604821313f9f tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:12.127047 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-27a10fef-2acd-4855-b4fa-604821313f9f tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:12.128159 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-27a10fef-2acd-4855-b4fa-604821313f9f tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:12.128949 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-27a10fef-2acd-4855-b4fa-604821313f9f tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:12.224077 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-17bd6e11-c39f-4424-a6ac-0fd5efd837b9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:12.234090 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-17bd6e11-c39f-4424-a6ac-0fd5efd837b9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.234560 Aug 27 01:33:12.235133 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 243/536] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:11 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:12.255587 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-27a10fef-2acd-4855-b4fa-604821313f9f tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:12.263692 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-27a10fef-2acd-4855-b4fa-604821313f9f tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1277 microversion: 2.1 time: 0.149020 Aug 27 01:33:12.264258 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 294/537] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:12 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1277 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:12.581209 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-b1bcb524-508c-4c64-80ba-66a8cfd8c2d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:12.582015 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-b1bcb524-508c-4c64-80ba-66a8cfd8c2d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:12.590015 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b1bcb524-508c-4c64-80ba-66a8cfd8c2d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:12.590470 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b1bcb524-508c-4c64-80ba-66a8cfd8c2d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:12.591245 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b1bcb524-508c-4c64-80ba-66a8cfd8c2d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:12.591686 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b1bcb524-508c-4c64-80ba-66a8cfd8c2d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:12.767861 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-b1bcb524-508c-4c64-80ba-66a8cfd8c2d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:12.775943 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-b1bcb524-508c-4c64-80ba-66a8cfd8c2d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:12.777485 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-b1bcb524-508c-4c64-80ba-66a8cfd8c2d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:12.778780 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-b1bcb524-508c-4c64-80ba-66a8cfd8c2d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1722 microversion: 2.20 time: 0.203036 Aug 27 01:33:12.779325 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 244/538] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:12 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:13.185772 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-7d83ed0b-da68-48fe-906d-5172e8911073 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:13.185772 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-7d83ed0b-da68-48fe-906d-5172e8911073 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:13.186422 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7d83ed0b-da68-48fe-906d-5172e8911073 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:13.186509 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7d83ed0b-da68-48fe-906d-5172e8911073 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:13.187305 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7d83ed0b-da68-48fe-906d-5172e8911073 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:13.187794 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7d83ed0b-da68-48fe-906d-5172e8911073 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:13.251819 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-b3d8db9e-35d6-4963-9632-603643cfb65d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:13.252640 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-b3d8db9e-35d6-4963-9632-603643cfb65d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:13.259421 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b3d8db9e-35d6-4963-9632-603643cfb65d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:13.259859 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b3d8db9e-35d6-4963-9632-603643cfb65d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:13.260622 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b3d8db9e-35d6-4963-9632-603643cfb65d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:13.261228 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b3d8db9e-35d6-4963-9632-603643cfb65d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:13.387060 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-b3d8db9e-35d6-4963-9632-603643cfb65d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:13.394657 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-b3d8db9e-35d6-4963-9632-603643cfb65d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1501 microversion: 2.1 time: 0.146862 Aug 27 01:33:13.395456 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 245/539] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:13 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1501 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:33:13.400120 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-d7f19bf7-06cf-46eb-905f-f3d408eda2ed tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:13.400907 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-d7f19bf7-06cf-46eb-905f-f3d408eda2ed tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:13.405633 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-7d83ed0b-da68-48fe-906d-5172e8911073 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:13.407326 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d7f19bf7-06cf-46eb-905f-f3d408eda2ed tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:13.413923 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d7f19bf7-06cf-46eb-905f-f3d408eda2ed tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:13.413923 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d7f19bf7-06cf-46eb-905f-f3d408eda2ed tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:13.413923 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d7f19bf7-06cf-46eb-905f-f3d408eda2ed tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:13.419603 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-7d83ed0b-da68-48fe-906d-5172e8911073 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1722 microversion: 2.1 time: 0.245499 Aug 27 01:33:13.420185 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 295/540] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:13 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:13.425515 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-59c44e28-7457-4b88-a88e-1736a1189afc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d6564f3-6802-48ba-a372-cd2a02f34a7c"}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:33:13.426690 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-59c44e28-7457-4b88-a88e-1736a1189afc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:13.433547 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-59c44e28-7457-4b88-a88e-1736a1189afc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:13.433998 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-59c44e28-7457-4b88-a88e-1736a1189afc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:13.434766 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-59c44e28-7457-4b88-a88e-1736a1189afc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:13.435199 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-59c44e28-7457-4b88-a88e-1736a1189afc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:13.462316 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.wsgi [None req-59c44e28-7457-4b88-a88e-1736a1189afc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] HTTP exception thrown: Cannot 'attach_volume' instance 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 while it is in vm_state rescued Aug 27 01:33:13.463108 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-59c44e28-7457-4b88-a88e-1736a1189afc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Returning 409 to user: Cannot 'attach_volume' instance 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 while it is in vm_state rescued {{(pid=108755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:33:13.463940 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-59c44e28-7457-4b88-a88e-1736a1189afc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "POST /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042036 Aug 27 01:33:13.464490 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 296/541] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Aug 27 01:33:13 2021] POST /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 01:33:13.473567 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-7fd0f497-af86-4239-aa11-d5db48ff64af tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:33:13.484285 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-7fd0f497-af86-4239-aa11-d5db48ff64af tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:13.486918 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7fd0f497-af86-4239-aa11-d5db48ff64af tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:13.487531 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7fd0f497-af86-4239-aa11-d5db48ff64af tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:13.488505 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7fd0f497-af86-4239-aa11-d5db48ff64af tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:13.489071 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7fd0f497-af86-4239-aa11-d5db48ff64af tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:13.570482 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-d7f19bf7-06cf-46eb-905f-f3d408eda2ed tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:13.586403 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-d7f19bf7-06cf-46eb-905f-f3d408eda2ed tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1317 microversion: 2.1 time: 0.182976 Aug 27 01:33:13.586403 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 246/542] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:13 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:13.722645 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-7fd0f497-af86-4239-aa11-d5db48ff64af tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "POST /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118/action" status: 202 len: 0 microversion: 2.1 time: 0.252988 Aug 27 01:33:13.726590 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 297/543] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:33:13 2021] POST /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:33:13.731986 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c090c812-cca5-4286-9842-95870bf58c07 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:13.732591 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c090c812-cca5-4286-9842-95870bf58c07 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:13.738993 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c090c812-cca5-4286-9842-95870bf58c07 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:13.739424 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c090c812-cca5-4286-9842-95870bf58c07 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:13.740318 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c090c812-cca5-4286-9842-95870bf58c07 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:13.740759 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c090c812-cca5-4286-9842-95870bf58c07 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:13.797215 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-49e9a66d-7252-494d-821d-49a0ad939719 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:13.798070 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-49e9a66d-7252-494d-821d-49a0ad939719 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:13.804435 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-49e9a66d-7252-494d-821d-49a0ad939719 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:13.804909 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-49e9a66d-7252-494d-821d-49a0ad939719 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:13.811058 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-49e9a66d-7252-494d-821d-49a0ad939719 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:13.811058 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-49e9a66d-7252-494d-821d-49a0ad939719 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:13.874896 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c090c812-cca5-4286-9842-95870bf58c07 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:13.883131 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c090c812-cca5-4286-9842-95870bf58c07 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1509 microversion: 2.1 time: 0.154686 Aug 27 01:33:13.884051 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 247/544] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:13 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:13.938087 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-5d42b4f2-91a9-4730-b227-4f959ad28aea req-1476f994-79fb-4165-a9d0-6baa974e6778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc5d2b5b-0f23-4214-b423-29eea2193d17", "tag": "f2d1dc8e-03dc-48d4-8646-8593c647e298"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:33:13.939636 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:33:13.939636 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:33:13.947725 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-5d42b4f2-91a9-4730-b227-4f959ad28aea req-1476f994-79fb-4165-a9d0-6baa974e6778 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:13.949014 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-5d42b4f2-91a9-4730-b227-4f959ad28aea req-1476f994-79fb-4165-a9d0-6baa974e6778 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:13.959852 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-5d42b4f2-91a9-4730-b227-4f959ad28aea req-1476f994-79fb-4165-a9d0-6baa974e6778 service nova] Creating event network-changed:f2d1dc8e-03dc-48d4-8646-8593c647e298 for instance fc5d2b5b-0f23-4214-b423-29eea2193d17 on hv-cinder-75916 Aug 27 01:33:13.964418 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-5d42b4f2-91a9-4730-b227-4f959ad28aea req-1476f994-79fb-4165-a9d0-6baa974e6778 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030021 Aug 27 01:33:13.966316 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 248/545] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:33:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:33:14.026481 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-6a1c9d79-03c2-46b1-8339-27738e0593c9 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c541655-cad6-4be5-bd16-8a922d7bb391", "device": "/dev/sdb"}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:33:14.028223 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-6a1c9d79-03c2-46b1-8339-27738e0593c9 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:14.034476 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6a1c9d79-03c2-46b1-8339-27738e0593c9 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:14.035163 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6a1c9d79-03c2-46b1-8339-27738e0593c9 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:14.035881 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6a1c9d79-03c2-46b1-8339-27738e0593c9 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:14.036313 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6a1c9d79-03c2-46b1-8339-27738e0593c9 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:14.069495 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-49e9a66d-7252-494d-821d-49a0ad939719 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:14.087467 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-49e9a66d-7252-494d-821d-49a0ad939719 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:14.089460 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-49e9a66d-7252-494d-821d-49a0ad939719 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:14.090759 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-49e9a66d-7252-494d-821d-49a0ad939719 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1722 microversion: 2.20 time: 0.297817 Aug 27 01:33:14.091507 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 298/546] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:13 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:33:14.438468 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-e0d9ad0b-4601-4b7b-b845-53e7b90e0f44 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:14.439113 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-e0d9ad0b-4601-4b7b-b845-53e7b90e0f44 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:14.445193 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e0d9ad0b-4601-4b7b-b845-53e7b90e0f44 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:14.445569 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e0d9ad0b-4601-4b7b-b845-53e7b90e0f44 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:14.446838 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e0d9ad0b-4601-4b7b-b845-53e7b90e0f44 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:14.447349 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e0d9ad0b-4601-4b7b-b845-53e7b90e0f44 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:14.777464 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-e0d9ad0b-4601-4b7b-b845-53e7b90e0f44 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:14.777667 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-6a1c9d79-03c2-46b1-8339-27738e0593c9 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "POST /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.756945 Aug 27 01:33:14.778136 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 249/547] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Aug 27 01:33:14 2021] POST /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e/os-volume_attachments => generated 194 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:33:14.788217 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-dce8eaf6-c841-462f-b308-2b765669fdef tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:14.788851 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-dce8eaf6-c841-462f-b308-2b765669fdef tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:14.795867 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-e0d9ad0b-4601-4b7b-b845-53e7b90e0f44 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1722 microversion: 2.1 time: 0.361238 Aug 27 01:33:14.796539 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-dce8eaf6-c841-462f-b308-2b765669fdef tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:14.797027 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-dce8eaf6-c841-462f-b308-2b765669fdef tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:14.799484 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-dce8eaf6-c841-462f-b308-2b765669fdef tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:14.800095 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-dce8eaf6-c841-462f-b308-2b765669fdef tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:14.806964 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 299/548] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:14 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1722 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:33:14.900032 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-77450e2a-ffed-4487-9e0d-5fe5f6b3f303 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:14.900684 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-77450e2a-ffed-4487-9e0d-5fe5f6b3f303 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:14.907254 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-77450e2a-ffed-4487-9e0d-5fe5f6b3f303 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:14.907917 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-77450e2a-ffed-4487-9e0d-5fe5f6b3f303 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:14.908980 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-77450e2a-ffed-4487-9e0d-5fe5f6b3f303 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:14.909590 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-77450e2a-ffed-4487-9e0d-5fe5f6b3f303 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:14.936939 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-dce8eaf6-c841-462f-b308-2b765669fdef tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:14.944465 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-dce8eaf6-c841-462f-b308-2b765669fdef tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1317 microversion: 2.1 time: 0.165025 Aug 27 01:33:14.945057 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 250/549] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:14 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:15.086994 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-77450e2a-ffed-4487-9e0d-5fe5f6b3f303 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:15.094717 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-77450e2a-ffed-4487-9e0d-5fe5f6b3f303 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1509 microversion: 2.1 time: 0.199063 Aug 27 01:33:15.095274 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 300/550] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:14 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1509 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:33:15.109228 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-0499592c-51d2-484c-bf77-bee0ac4aa864 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:15.109822 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-0499592c-51d2-484c-bf77-bee0ac4aa864 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:15.115644 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0499592c-51d2-484c-bf77-bee0ac4aa864 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:15.116084 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0499592c-51d2-484c-bf77-bee0ac4aa864 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:15.116858 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0499592c-51d2-484c-bf77-bee0ac4aa864 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:15.117303 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0499592c-51d2-484c-bf77-bee0ac4aa864 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:15.264084 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0499592c-51d2-484c-bf77-bee0ac4aa864 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:15.273304 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0499592c-51d2-484c-bf77-bee0ac4aa864 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:15.275310 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0499592c-51d2-484c-bf77-bee0ac4aa864 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:15.276642 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-0499592c-51d2-484c-bf77-bee0ac4aa864 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1722 microversion: 2.20 time: 0.171068 Aug 27 01:33:15.277280 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 251/551] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:15 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:15.827075 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-95727d5e-4b78-4e64-82f4-3d93de620777 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:15.827718 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-95727d5e-4b78-4e64-82f4-3d93de620777 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:15.833724 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-95727d5e-4b78-4e64-82f4-3d93de620777 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:15.834184 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-95727d5e-4b78-4e64-82f4-3d93de620777 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:15.835222 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-95727d5e-4b78-4e64-82f4-3d93de620777 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:15.835658 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-95727d5e-4b78-4e64-82f4-3d93de620777 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:15.962236 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-bf519704-d417-48cc-96b6-ca555cdc824c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:15.962856 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-bf519704-d417-48cc-96b6-ca555cdc824c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:15.963674 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-95727d5e-4b78-4e64-82f4-3d93de620777 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:15.969563 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bf519704-d417-48cc-96b6-ca555cdc824c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:15.972500 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bf519704-d417-48cc-96b6-ca555cdc824c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:15.972500 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bf519704-d417-48cc-96b6-ca555cdc824c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:15.972500 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bf519704-d417-48cc-96b6-ca555cdc824c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:15.972750 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-95727d5e-4b78-4e64-82f4-3d93de620777 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1722 microversion: 2.1 time: 0.148455 Aug 27 01:33:15.972750 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 301/552] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:15 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:16.093472 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-bf519704-d417-48cc-96b6-ca555cdc824c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:16.100787 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-bf519704-d417-48cc-96b6-ca555cdc824c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1317 microversion: 2.1 time: 0.142940 Aug 27 01:33:16.101393 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 252/553] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:15 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:33:16.111214 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-1f9c5178-4fb5-4dec-a690-a32b46316a3b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:16.111867 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-1f9c5178-4fb5-4dec-a690-a32b46316a3b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:16.117886 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1f9c5178-4fb5-4dec-a690-a32b46316a3b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:16.118267 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1f9c5178-4fb5-4dec-a690-a32b46316a3b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:16.119089 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1f9c5178-4fb5-4dec-a690-a32b46316a3b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:16.119518 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1f9c5178-4fb5-4dec-a690-a32b46316a3b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:16.246447 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-1f9c5178-4fb5-4dec-a690-a32b46316a3b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:16.254297 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-1f9c5178-4fb5-4dec-a690-a32b46316a3b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1509 microversion: 2.1 time: 0.146651 Aug 27 01:33:16.255190 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 302/554] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:16 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1509 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:16.294714 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-3b26dc92-ef69-4de1-89a8-9c440fd19333 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:16.295323 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-3b26dc92-ef69-4de1-89a8-9c440fd19333 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:16.301064 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3b26dc92-ef69-4de1-89a8-9c440fd19333 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:16.301524 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3b26dc92-ef69-4de1-89a8-9c440fd19333 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:16.302560 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3b26dc92-ef69-4de1-89a8-9c440fd19333 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:16.302998 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3b26dc92-ef69-4de1-89a8-9c440fd19333 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:16.426613 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-3b26dc92-ef69-4de1-89a8-9c440fd19333 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:16.435782 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-3b26dc92-ef69-4de1-89a8-9c440fd19333 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:16.437318 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-3b26dc92-ef69-4de1-89a8-9c440fd19333 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:16.438461 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-3b26dc92-ef69-4de1-89a8-9c440fd19333 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1722 microversion: 2.20 time: 0.147399 Aug 27 01:33:16.439013 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 253/555] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:16 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:33:16.989384 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-922f63e0-c166-4722-a79a-a9f0310c7bbe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:16.989970 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-922f63e0-c166-4722-a79a-a9f0310c7bbe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:16.996007 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-922f63e0-c166-4722-a79a-a9f0310c7bbe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:16.996448 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-922f63e0-c166-4722-a79a-a9f0310c7bbe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:16.997257 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-922f63e0-c166-4722-a79a-a9f0310c7bbe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:16.997689 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-922f63e0-c166-4722-a79a-a9f0310c7bbe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:17.118196 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-6b7389a5-b5d7-4f51-bf7e-199fa0dc5896 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:17.118939 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-6b7389a5-b5d7-4f51-bf7e-199fa0dc5896 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:17.124887 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6b7389a5-b5d7-4f51-bf7e-199fa0dc5896 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:17.125340 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6b7389a5-b5d7-4f51-bf7e-199fa0dc5896 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:17.126106 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6b7389a5-b5d7-4f51-bf7e-199fa0dc5896 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:17.126535 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6b7389a5-b5d7-4f51-bf7e-199fa0dc5896 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:17.127462 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-922f63e0-c166-4722-a79a-a9f0310c7bbe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:17.135977 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-922f63e0-c166-4722-a79a-a9f0310c7bbe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1722 microversion: 2.1 time: 0.150090 Aug 27 01:33:17.136540 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 303/556] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:16 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:17.262940 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-6b7389a5-b5d7-4f51-bf7e-199fa0dc5896 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:17.271069 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-6b7389a5-b5d7-4f51-bf7e-199fa0dc5896 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1317 microversion: 2.1 time: 0.156455 Aug 27 01:33:17.271507 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-af077946-cec3-41d2-a401-33a2895102a3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:17.272099 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 254/557] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:17 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:33:17.272239 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-af077946-cec3-41d2-a401-33a2895102a3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:17.278750 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-af077946-cec3-41d2-a401-33a2895102a3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:17.279187 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-af077946-cec3-41d2-a401-33a2895102a3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:17.279990 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-af077946-cec3-41d2-a401-33a2895102a3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:17.280386 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-af077946-cec3-41d2-a401-33a2895102a3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:17.409857 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-af077946-cec3-41d2-a401-33a2895102a3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:17.422297 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-af077946-cec3-41d2-a401-33a2895102a3 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1509 microversion: 2.1 time: 0.154510 Aug 27 01:33:17.423479 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 304/558] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:17 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:33:17.455799 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-3125ec8b-693f-437a-9449-4bed34fbcc60 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:17.458564 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-3125ec8b-693f-437a-9449-4bed34fbcc60 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:17.463189 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3125ec8b-693f-437a-9449-4bed34fbcc60 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:17.463631 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3125ec8b-693f-437a-9449-4bed34fbcc60 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:17.464556 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3125ec8b-693f-437a-9449-4bed34fbcc60 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:17.465172 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3125ec8b-693f-437a-9449-4bed34fbcc60 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:17.863767 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-3125ec8b-693f-437a-9449-4bed34fbcc60 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:17.872690 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-3125ec8b-693f-437a-9449-4bed34fbcc60 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:17.874253 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-3125ec8b-693f-437a-9449-4bed34fbcc60 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:17.875441 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-3125ec8b-693f-437a-9449-4bed34fbcc60 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1722 microversion: 2.20 time: 0.423261 Aug 27 01:33:17.876182 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 255/559] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:17 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1722 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:33:18.154112 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b239847c-31e5-48f8-b6e3-8184abfd345d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:18.154928 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b239847c-31e5-48f8-b6e3-8184abfd345d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:18.160859 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b239847c-31e5-48f8-b6e3-8184abfd345d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:18.161378 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b239847c-31e5-48f8-b6e3-8184abfd345d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:18.162232 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b239847c-31e5-48f8-b6e3-8184abfd345d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:18.162769 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b239847c-31e5-48f8-b6e3-8184abfd345d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:18.282089 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-b239847c-31e5-48f8-b6e3-8184abfd345d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:18.288524 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-eb31e48f-d288-4367-b7d5-dbc9a862e302 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:18.290151 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-eb31e48f-d288-4367-b7d5-dbc9a862e302 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:18.294191 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b239847c-31e5-48f8-b6e3-8184abfd345d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1722 microversion: 2.1 time: 0.144874 Aug 27 01:33:18.304168 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 305/560] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:18 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1722 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:18.304681 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-eb31e48f-d288-4367-b7d5-dbc9a862e302 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:18.304681 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-eb31e48f-d288-4367-b7d5-dbc9a862e302 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:18.304681 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-eb31e48f-d288-4367-b7d5-dbc9a862e302 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:18.304681 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-eb31e48f-d288-4367-b7d5-dbc9a862e302 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:18.424392 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-eb31e48f-d288-4367-b7d5-dbc9a862e302 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:18.432172 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-eb31e48f-d288-4367-b7d5-dbc9a862e302 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1317 microversion: 2.1 time: 0.147244 Aug 27 01:33:18.432743 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 256/561] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:18 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:18.445527 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-acb43741-7700-4acf-9bdb-6d98ab893df1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:18.447000 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-acb43741-7700-4acf-9bdb-6d98ab893df1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:18.456096 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-acb43741-7700-4acf-9bdb-6d98ab893df1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:18.456553 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-acb43741-7700-4acf-9bdb-6d98ab893df1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:18.457359 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-acb43741-7700-4acf-9bdb-6d98ab893df1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:18.457967 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-acb43741-7700-4acf-9bdb-6d98ab893df1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:18.582588 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-acb43741-7700-4acf-9bdb-6d98ab893df1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:18.590460 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-acb43741-7700-4acf-9bdb-6d98ab893df1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1515 microversion: 2.1 time: 0.148484 Aug 27 01:33:18.591024 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 306/562] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:18 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:18.892533 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-2dbfc709-0d7e-4193-81bd-2404cf1a6e19 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:18.893226 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-2dbfc709-0d7e-4193-81bd-2404cf1a6e19 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:18.899987 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2dbfc709-0d7e-4193-81bd-2404cf1a6e19 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:18.900474 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2dbfc709-0d7e-4193-81bd-2404cf1a6e19 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:18.901274 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2dbfc709-0d7e-4193-81bd-2404cf1a6e19 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:18.901702 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2dbfc709-0d7e-4193-81bd-2404cf1a6e19 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:19.025412 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-2dbfc709-0d7e-4193-81bd-2404cf1a6e19 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:19.034111 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-2dbfc709-0d7e-4193-81bd-2404cf1a6e19 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:19.035356 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-2dbfc709-0d7e-4193-81bd-2404cf1a6e19 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:19.037336 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-2dbfc709-0d7e-4193-81bd-2404cf1a6e19 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1743 microversion: 2.20 time: 0.148056 Aug 27 01:33:19.044692 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 257/563] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:18 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:19.313879 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-7aabe83a-4b0c-4626-a55c-5de96f50c82b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:19.314495 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-7aabe83a-4b0c-4626-a55c-5de96f50c82b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:19.321543 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7aabe83a-4b0c-4626-a55c-5de96f50c82b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:19.322071 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7aabe83a-4b0c-4626-a55c-5de96f50c82b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:19.322776 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7aabe83a-4b0c-4626-a55c-5de96f50c82b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:19.323513 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7aabe83a-4b0c-4626-a55c-5de96f50c82b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:19.449434 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-7aabe83a-4b0c-4626-a55c-5de96f50c82b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:19.449586 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-2e87d6c4-3644-4c78-9a0f-8f01699876d1 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:19.450156 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-2e87d6c4-3644-4c78-9a0f-8f01699876d1 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:19.457694 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2e87d6c4-3644-4c78-9a0f-8f01699876d1 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:19.458150 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2e87d6c4-3644-4c78-9a0f-8f01699876d1 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:19.458800 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-7aabe83a-4b0c-4626-a55c-5de96f50c82b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1722 microversion: 2.1 time: 0.149384 Aug 27 01:33:19.459416 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 307/564] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:19 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:19.461250 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2e87d6c4-3644-4c78-9a0f-8f01699876d1 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:19.461800 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2e87d6c4-3644-4c78-9a0f-8f01699876d1 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:19.589415 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-2e87d6c4-3644-4c78-9a0f-8f01699876d1 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:19.597320 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-2e87d6c4-3644-4c78-9a0f-8f01699876d1 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1317 microversion: 2.1 time: 0.151498 Aug 27 01:33:19.598429 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 258/565] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:19 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:33:20.055986 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-f7cec7a5-fc50-4c9d-adca-361f8e64f804 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:20.056611 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-f7cec7a5-fc50-4c9d-adca-361f8e64f804 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:20.062766 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f7cec7a5-fc50-4c9d-adca-361f8e64f804 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:20.063079 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f7cec7a5-fc50-4c9d-adca-361f8e64f804 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:20.063848 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f7cec7a5-fc50-4c9d-adca-361f8e64f804 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:20.064283 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f7cec7a5-fc50-4c9d-adca-361f8e64f804 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:20.187841 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-f7cec7a5-fc50-4c9d-adca-361f8e64f804 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:20.197474 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-f7cec7a5-fc50-4c9d-adca-361f8e64f804 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:20.198971 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-f7cec7a5-fc50-4c9d-adca-361f8e64f804 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:20.200288 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-f7cec7a5-fc50-4c9d-adca-361f8e64f804 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1743 microversion: 2.20 time: 0.148479 Aug 27 01:33:20.200856 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 308/566] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:20 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1743 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:20.259941 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-d2bb79f8-588e-4a19-b039-ee8533ad5b36 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:20.260545 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-d2bb79f8-588e-4a19-b039-ee8533ad5b36 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:20.266446 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d2bb79f8-588e-4a19-b039-ee8533ad5b36 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:20.266892 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d2bb79f8-588e-4a19-b039-ee8533ad5b36 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:20.267651 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d2bb79f8-588e-4a19-b039-ee8533ad5b36 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:20.268088 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d2bb79f8-588e-4a19-b039-ee8533ad5b36 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:20.390734 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-d2bb79f8-588e-4a19-b039-ee8533ad5b36 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:20.395910 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-d2bb79f8-588e-4a19-b039-ee8533ad5b36 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1515 microversion: 2.1 time: 0.140029 Aug 27 01:33:20.396524 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 259/567] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:20 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1515 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:20.412079 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-8e653e6f-6fdc-467a-ab62-ebb7c1e4aa1f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97327331-ac2b-4efb-89e5-46fc5cc8c13c"}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:33:20.413738 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-8e653e6f-6fdc-467a-ab62-ebb7c1e4aa1f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:20.420152 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8e653e6f-6fdc-467a-ab62-ebb7c1e4aa1f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:20.420599 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8e653e6f-6fdc-467a-ab62-ebb7c1e4aa1f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:20.421482 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8e653e6f-6fdc-467a-ab62-ebb7c1e4aa1f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:20.421945 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8e653e6f-6fdc-467a-ab62-ebb7c1e4aa1f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:20.479214 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-1960e2a5-e8d5-4122-b028-0ed2b16fd369 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:20.480018 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-1960e2a5-e8d5-4122-b028-0ed2b16fd369 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:20.486235 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1960e2a5-e8d5-4122-b028-0ed2b16fd369 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:20.486779 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1960e2a5-e8d5-4122-b028-0ed2b16fd369 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:20.487621 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1960e2a5-e8d5-4122-b028-0ed2b16fd369 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:20.488123 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1960e2a5-e8d5-4122-b028-0ed2b16fd369 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:20.633796 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-1960e2a5-e8d5-4122-b028-0ed2b16fd369 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:20.642390 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-1960e2a5-e8d5-4122-b028-0ed2b16fd369 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1722 microversion: 2.1 time: 0.167002 Aug 27 01:33:20.645617 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 260/568] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:20 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:33:20.647368 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ca0969bb-5786-4205-8d01-10a1742746d5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:20.647973 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-ca0969bb-5786-4205-8d01-10a1742746d5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:20.654121 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ca0969bb-5786-4205-8d01-10a1742746d5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:20.654755 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ca0969bb-5786-4205-8d01-10a1742746d5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:20.655537 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ca0969bb-5786-4205-8d01-10a1742746d5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:20.655969 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ca0969bb-5786-4205-8d01-10a1742746d5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:20.793966 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ca0969bb-5786-4205-8d01-10a1742746d5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:20.801289 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-ca0969bb-5786-4205-8d01-10a1742746d5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1317 microversion: 2.1 time: 0.157326 Aug 27 01:33:20.802295 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 261/569] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:20 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:21.181463 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-8e653e6f-6fdc-467a-ab62-ebb7c1e4aa1f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "POST /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.772841 Aug 27 01:33:21.182525 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 309/570] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Aug 27 01:33:20 2021] POST /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118/os-volume_attachments => generated 194 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:33:21.218643 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-5ad0f67a-396a-4fe6-87c6-6ad03a6459c8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:21.219248 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-5ad0f67a-396a-4fe6-87c6-6ad03a6459c8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:21.225249 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5ad0f67a-396a-4fe6-87c6-6ad03a6459c8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:21.225701 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5ad0f67a-396a-4fe6-87c6-6ad03a6459c8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:21.226505 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5ad0f67a-396a-4fe6-87c6-6ad03a6459c8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:21.227129 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5ad0f67a-396a-4fe6-87c6-6ad03a6459c8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:21.363575 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-5ad0f67a-396a-4fe6-87c6-6ad03a6459c8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:21.373624 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-5ad0f67a-396a-4fe6-87c6-6ad03a6459c8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:21.376242 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-5ad0f67a-396a-4fe6-87c6-6ad03a6459c8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:21.377353 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-5ad0f67a-396a-4fe6-87c6-6ad03a6459c8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1743 microversion: 2.20 time: 0.162376 Aug 27 01:33:21.400232 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-ee11839b-5581-4900-b715-3e8a1c7382e0 req-f4a2e90d-6820-4203-a952-430953922c3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc5d2b5b-0f23-4214-b423-29eea2193d17", "name": "network-vif-plugged", "status": "completed", "tag": "f2d1dc8e-03dc-48d4-8646-8593c647e298"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:33:21.411172 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:33:21.411172 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:33:21.413009 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 262/571] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:21 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1743 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:21.421235 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-ee11839b-5581-4900-b715-3e8a1c7382e0 req-f4a2e90d-6820-4203-a952-430953922c3f service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:21.422712 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-ee11839b-5581-4900-b715-3e8a1c7382e0 req-f4a2e90d-6820-4203-a952-430953922c3f service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:21.438607 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-ee11839b-5581-4900-b715-3e8a1c7382e0 req-f4a2e90d-6820-4203-a952-430953922c3f service nova] Creating event network-vif-plugged:f2d1dc8e-03dc-48d4-8646-8593c647e298 for instance fc5d2b5b-0f23-4214-b423-29eea2193d17 on hv-cinder-75916 Aug 27 01:33:21.445046 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-ee11839b-5581-4900-b715-3e8a1c7382e0 req-f4a2e90d-6820-4203-a952-430953922c3f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047438 Aug 27 01:33:21.445046 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 310/572] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:33:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:33:21.659803 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-5c537863-5f44-4967-bad8-53913da3d0ff tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:21.660409 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-5c537863-5f44-4967-bad8-53913da3d0ff tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:21.666698 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5c537863-5f44-4967-bad8-53913da3d0ff tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:21.667147 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5c537863-5f44-4967-bad8-53913da3d0ff tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:21.667913 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5c537863-5f44-4967-bad8-53913da3d0ff tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:21.668349 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5c537863-5f44-4967-bad8-53913da3d0ff tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:21.811475 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-5c537863-5f44-4967-bad8-53913da3d0ff tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:21.819706 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-5c537863-5f44-4967-bad8-53913da3d0ff tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1699 microversion: 2.1 time: 0.163427 Aug 27 01:33:21.825871 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 263/573] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:21 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1699 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:21.826059 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-e9ead517-8746-4da1-ac8f-219a6d560cee tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:21.826059 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-e9ead517-8746-4da1-ac8f-219a6d560cee tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:21.828440 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e9ead517-8746-4da1-ac8f-219a6d560cee tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:21.829023 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e9ead517-8746-4da1-ac8f-219a6d560cee tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:21.829889 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e9ead517-8746-4da1-ac8f-219a6d560cee tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:21.830418 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e9ead517-8746-4da1-ac8f-219a6d560cee tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:21.835774 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-85bf0ee6-caff-445c-8dc2-4d4bf914f6a4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:33:21.842353 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-85bf0ee6-caff-445c-8dc2-4d4bf914f6a4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:21.842874 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-85bf0ee6-caff-445c-8dc2-4d4bf914f6a4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:21.903415 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-85bf0ee6-caff-445c-8dc2-4d4bf914f6a4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Going to try to start instance {{(pid=108756) start /opt/stack/nova/nova/compute/api.py:2638}} Aug 27 01:33:22.027069 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-e9ead517-8746-4da1-ac8f-219a6d560cee tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:22.034288 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-e9ead517-8746-4da1-ac8f-219a6d560cee tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1317 microversion: 2.1 time: 0.218147 Aug 27 01:33:22.034840 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 311/574] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:21 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:33:22.071934 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-85bf0ee6-caff-445c-8dc2-4d4bf914f6a4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 202 len: 0 microversion: 2.1 time: 0.239520 Aug 27 01:33:22.075387 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 264/575] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:33:21 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:33:22.080845 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-abfaa2f9-2e11-4591-971b-2e048db8a748 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:22.081571 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-abfaa2f9-2e11-4591-971b-2e048db8a748 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:22.088663 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-abfaa2f9-2e11-4591-971b-2e048db8a748 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:22.089141 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-abfaa2f9-2e11-4591-971b-2e048db8a748 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:22.089917 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-abfaa2f9-2e11-4591-971b-2e048db8a748 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:22.090348 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-abfaa2f9-2e11-4591-971b-2e048db8a748 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:22.211067 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-abfaa2f9-2e11-4591-971b-2e048db8a748 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:22.219159 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-abfaa2f9-2e11-4591-971b-2e048db8a748 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1708 microversion: 2.1 time: 0.142134 Aug 27 01:33:22.219630 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 312/576] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:22 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1708 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:33:22.450780 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ebe0fd1d-6340-4184-9d46-3f5d8465d5d4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:22.450780 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-ebe0fd1d-6340-4184-9d46-3f5d8465d5d4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:22.454513 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ebe0fd1d-6340-4184-9d46-3f5d8465d5d4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:22.454959 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ebe0fd1d-6340-4184-9d46-3f5d8465d5d4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:22.455735 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ebe0fd1d-6340-4184-9d46-3f5d8465d5d4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:22.456189 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ebe0fd1d-6340-4184-9d46-3f5d8465d5d4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:22.592380 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ebe0fd1d-6340-4184-9d46-3f5d8465d5d4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:22.602834 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ebe0fd1d-6340-4184-9d46-3f5d8465d5d4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:22.604445 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ebe0fd1d-6340-4184-9d46-3f5d8465d5d4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:22.605911 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-ebe0fd1d-6340-4184-9d46-3f5d8465d5d4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1738 microversion: 2.20 time: 0.164217 Aug 27 01:33:22.609211 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 265/577] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:22 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:23.052174 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-e517dfe5-aa99-4e59-8497-e03f04f673f3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:23.052787 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-e517dfe5-aa99-4e59-8497-e03f04f673f3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:23.061810 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e517dfe5-aa99-4e59-8497-e03f04f673f3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:23.062840 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e517dfe5-aa99-4e59-8497-e03f04f673f3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:23.063972 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e517dfe5-aa99-4e59-8497-e03f04f673f3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:23.064624 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e517dfe5-aa99-4e59-8497-e03f04f673f3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:23.237615 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-52b3f64b-fbad-4516-896a-50b1ccbdfab9 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:23.239224 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-52b3f64b-fbad-4516-896a-50b1ccbdfab9 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:23.246493 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-52b3f64b-fbad-4516-896a-50b1ccbdfab9 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:23.247238 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-52b3f64b-fbad-4516-896a-50b1ccbdfab9 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:23.254654 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-52b3f64b-fbad-4516-896a-50b1ccbdfab9 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:23.254654 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-52b3f64b-fbad-4516-896a-50b1ccbdfab9 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:23.269706 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-e517dfe5-aa99-4e59-8497-e03f04f673f3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:23.278927 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-e517dfe5-aa99-4e59-8497-e03f04f673f3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1317 microversion: 2.1 time: 0.230593 Aug 27 01:33:23.290295 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 313/578] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:23 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:23.465178 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-92d98258-c950-4da0-bdbd-64c385d96b97 req-65de62f2-d80f-4612-acbd-5b8c48c59340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ec83298-8a1e-4edd-be07-4e0592a0ce04", "name": "network-vif-plugged", "status": "completed", "tag": "5f7cab4d-54ba-4757-bb8d-1d2f0a14a90e"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:33:23.467862 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:33:23.467862 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:33:23.508701 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-52b3f64b-fbad-4516-896a-50b1ccbdfab9 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:23.518142 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-52b3f64b-fbad-4516-896a-50b1ccbdfab9 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1708 microversion: 2.1 time: 0.284040 Aug 27 01:33:23.518356 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-92d98258-c950-4da0-bdbd-64c385d96b97 req-65de62f2-d80f-4612-acbd-5b8c48c59340 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:23.518706 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-92d98258-c950-4da0-bdbd-64c385d96b97 req-65de62f2-d80f-4612-acbd-5b8c48c59340 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:23.519629 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 266/579] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:23 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1708 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:23.545600 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-92d98258-c950-4da0-bdbd-64c385d96b97 req-65de62f2-d80f-4612-acbd-5b8c48c59340 service nova] Creating event network-vif-plugged:5f7cab4d-54ba-4757-bb8d-1d2f0a14a90e for instance 6ec83298-8a1e-4edd-be07-4e0592a0ce04 on hv-cinder-75916 Aug 27 01:33:23.551348 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-92d98258-c950-4da0-bdbd-64c385d96b97 req-65de62f2-d80f-4612-acbd-5b8c48c59340 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096802 Aug 27 01:33:23.552516 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 314/580] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:33:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:33:23.625014 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-da71e3b7-b0a6-4fd6-aada-ce0830b4b2cf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:23.625754 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-da71e3b7-b0a6-4fd6-aada-ce0830b4b2cf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:23.632152 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-da71e3b7-b0a6-4fd6-aada-ce0830b4b2cf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:23.632902 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-da71e3b7-b0a6-4fd6-aada-ce0830b4b2cf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:23.634449 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-da71e3b7-b0a6-4fd6-aada-ce0830b4b2cf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:23.635182 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-da71e3b7-b0a6-4fd6-aada-ce0830b4b2cf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:23.790598 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-da71e3b7-b0a6-4fd6-aada-ce0830b4b2cf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:23.806646 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-da71e3b7-b0a6-4fd6-aada-ce0830b4b2cf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:23.809911 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-da71e3b7-b0a6-4fd6-aada-ce0830b4b2cf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:23.812101 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-da71e3b7-b0a6-4fd6-aada-ce0830b4b2cf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1738 microversion: 2.20 time: 0.191056 Aug 27 01:33:23.813130 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 267/581] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:23 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:24.307952 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-767cdac4-1951-4365-87ed-54abb2465156 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:24.308560 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-767cdac4-1951-4365-87ed-54abb2465156 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:24.321792 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-767cdac4-1951-4365-87ed-54abb2465156 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:24.324472 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-767cdac4-1951-4365-87ed-54abb2465156 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:24.325515 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-767cdac4-1951-4365-87ed-54abb2465156 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:24.326265 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-767cdac4-1951-4365-87ed-54abb2465156 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:24.520396 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-767cdac4-1951-4365-87ed-54abb2465156 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:24.530025 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-767cdac4-1951-4365-87ed-54abb2465156 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1507 microversion: 2.1 time: 0.229638 Aug 27 01:33:24.531284 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 315/582] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:24 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1507 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:24.536412 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ae0a9062-b696-4275-8d91-df18c58dcf70 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:24.537691 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-ae0a9062-b696-4275-8d91-df18c58dcf70 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:24.545363 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ae0a9062-b696-4275-8d91-df18c58dcf70 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:24.547219 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ae0a9062-b696-4275-8d91-df18c58dcf70 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:24.548508 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ae0a9062-b696-4275-8d91-df18c58dcf70 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:24.549192 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ae0a9062-b696-4275-8d91-df18c58dcf70 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:24.743965 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ae0a9062-b696-4275-8d91-df18c58dcf70 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:24.771930 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-ae0a9062-b696-4275-8d91-df18c58dcf70 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1708 microversion: 2.1 time: 0.236136 Aug 27 01:33:24.782265 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 268/583] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:24 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1708 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:24.833420 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-592f7bd1-ba82-44a9-9183-7cc45611df48 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:24.834153 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-592f7bd1-ba82-44a9-9183-7cc45611df48 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:24.846067 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-592f7bd1-ba82-44a9-9183-7cc45611df48 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:24.846562 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-592f7bd1-ba82-44a9-9183-7cc45611df48 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:24.847541 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-592f7bd1-ba82-44a9-9183-7cc45611df48 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:24.848094 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-592f7bd1-ba82-44a9-9183-7cc45611df48 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:25.023064 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-592f7bd1-ba82-44a9-9183-7cc45611df48 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:25.034150 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-592f7bd1-ba82-44a9-9183-7cc45611df48 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:25.036446 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-592f7bd1-ba82-44a9-9183-7cc45611df48 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:25.038453 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-592f7bd1-ba82-44a9-9183-7cc45611df48 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1738 microversion: 2.20 time: 0.210468 Aug 27 01:33:25.040176 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 316/584] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:24 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1738 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:25.790673 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-a625796c-d62a-4066-8a82-b0becc170993 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:25.792114 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-a625796c-d62a-4066-8a82-b0becc170993 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:25.807957 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a625796c-d62a-4066-8a82-b0becc170993 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:25.815171 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a625796c-d62a-4066-8a82-b0becc170993 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:25.817498 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a625796c-d62a-4066-8a82-b0becc170993 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:25.819300 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a625796c-d62a-4066-8a82-b0becc170993 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:25.988935 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-a625796c-d62a-4066-8a82-b0becc170993 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:25.999085 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-a625796c-d62a-4066-8a82-b0becc170993 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1712 microversion: 2.1 time: 0.213795 Aug 27 01:33:26.005811 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 269/585] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:25 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1712 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:26.065381 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-ba252c08-9f3f-489e-8416-f92eb3f5d14f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:26.066637 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-ba252c08-9f3f-489e-8416-f92eb3f5d14f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:26.074251 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ba252c08-9f3f-489e-8416-f92eb3f5d14f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:26.074719 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ba252c08-9f3f-489e-8416-f92eb3f5d14f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:26.075786 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ba252c08-9f3f-489e-8416-f92eb3f5d14f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:26.076225 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ba252c08-9f3f-489e-8416-f92eb3f5d14f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:26.235510 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-ba252c08-9f3f-489e-8416-f92eb3f5d14f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:26.245707 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-ba252c08-9f3f-489e-8416-f92eb3f5d14f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:26.247637 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-ba252c08-9f3f-489e-8416-f92eb3f5d14f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:26.248791 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-ba252c08-9f3f-489e-8416-f92eb3f5d14f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1738 microversion: 2.20 time: 0.187597 Aug 27 01:33:26.249564 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 317/586] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:26 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:27.266333 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-1bc45352-faec-44ee-b8ce-17e08e39541f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:27.266937 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-1bc45352-faec-44ee-b8ce-17e08e39541f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:27.273582 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1bc45352-faec-44ee-b8ce-17e08e39541f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:27.274362 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1bc45352-faec-44ee-b8ce-17e08e39541f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:27.275442 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1bc45352-faec-44ee-b8ce-17e08e39541f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:27.275944 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1bc45352-faec-44ee-b8ce-17e08e39541f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:27.435475 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-1bc45352-faec-44ee-b8ce-17e08e39541f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:27.445506 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-1bc45352-faec-44ee-b8ce-17e08e39541f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:27.449382 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-1bc45352-faec-44ee-b8ce-17e08e39541f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:27.451794 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-1bc45352-faec-44ee-b8ce-17e08e39541f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1738 microversion: 2.20 time: 0.188972 Aug 27 01:33:27.452818 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 270/587] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:27 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:27.868217 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-8331f9cc-d60d-4d59-bab9-6291ad0eb723 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb3a7d67-f304-4898-9e3a-9217f44fe613"}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:33:27.869471 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-8331f9cc-d60d-4d59-bab9-6291ad0eb723 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:27.875777 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8331f9cc-d60d-4d59-bab9-6291ad0eb723 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:27.876544 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8331f9cc-d60d-4d59-bab9-6291ad0eb723 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:27.878470 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8331f9cc-d60d-4d59-bab9-6291ad0eb723 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:27.879079 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8331f9cc-d60d-4d59-bab9-6291ad0eb723 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:28.473554 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ebc8b62b-c623-40b1-930a-35c9feb6e130 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:28.474640 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-ebc8b62b-c623-40b1-930a-35c9feb6e130 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:28.484117 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ebc8b62b-c623-40b1-930a-35c9feb6e130 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:28.484560 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ebc8b62b-c623-40b1-930a-35c9feb6e130 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:28.485572 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ebc8b62b-c623-40b1-930a-35c9feb6e130 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:28.486011 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ebc8b62b-c623-40b1-930a-35c9feb6e130 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:28.618749 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ebc8b62b-c623-40b1-930a-35c9feb6e130 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:28.629091 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ebc8b62b-c623-40b1-930a-35c9feb6e130 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:28.630659 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ebc8b62b-c623-40b1-930a-35c9feb6e130 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:28.631871 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-ebc8b62b-c623-40b1-930a-35c9feb6e130 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1738 microversion: 2.20 time: 0.163153 Aug 27 01:33:28.632504 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 271/588] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:28 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:33:29.650535 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-6034acf7-7300-4d11-82e6-bc0f75882545 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:29.651228 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-6034acf7-7300-4d11-82e6-bc0f75882545 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:29.657148 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6034acf7-7300-4d11-82e6-bc0f75882545 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:29.657598 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6034acf7-7300-4d11-82e6-bc0f75882545 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:29.658363 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6034acf7-7300-4d11-82e6-bc0f75882545 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:29.658795 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6034acf7-7300-4d11-82e6-bc0f75882545 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:29.785312 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-6034acf7-7300-4d11-82e6-bc0f75882545 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:29.793943 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-6034acf7-7300-4d11-82e6-bc0f75882545 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:29.795457 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-6034acf7-7300-4d11-82e6-bc0f75882545 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:29.796626 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-6034acf7-7300-4d11-82e6-bc0f75882545 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1738 microversion: 2.20 time: 0.150049 Aug 27 01:33:29.797220 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 272/589] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:29 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:33:30.568165 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-8331f9cc-d60d-4d59-bab9-6291ad0eb723 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "POST /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.703642 Aug 27 01:33:30.569204 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 318/590] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Aug 27 01:33:27 2021] POST /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17/os-volume_attachments => generated 194 bytes in 2705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:33:30.824046 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-753c257a-352e-4e4e-b6d4-8b0bef063bbc tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:30.824655 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-753c257a-352e-4e4e-b6d4-8b0bef063bbc tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:30.832615 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-753c257a-352e-4e4e-b6d4-8b0bef063bbc tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:30.835496 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-753c257a-352e-4e4e-b6d4-8b0bef063bbc tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:30.835496 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-753c257a-352e-4e4e-b6d4-8b0bef063bbc tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:30.835496 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-753c257a-352e-4e4e-b6d4-8b0bef063bbc tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:30.987580 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-753c257a-352e-4e4e-b6d4-8b0bef063bbc tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:30.995584 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-753c257a-352e-4e4e-b6d4-8b0bef063bbc tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:30.997437 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-753c257a-352e-4e4e-b6d4-8b0bef063bbc tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:30.998754 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-753c257a-352e-4e4e-b6d4-8b0bef063bbc tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1738 microversion: 2.20 time: 0.179293 Aug 27 01:33:31.013203 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 273/591] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:30 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:32.029187 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-72cd205c-5f0c-48dc-93dd-ca4c6cb64996 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:32.030079 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-72cd205c-5f0c-48dc-93dd-ca4c6cb64996 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:32.046429 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-72cd205c-5f0c-48dc-93dd-ca4c6cb64996 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:32.047391 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-72cd205c-5f0c-48dc-93dd-ca4c6cb64996 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:32.047796 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-72cd205c-5f0c-48dc-93dd-ca4c6cb64996 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:32.048409 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-72cd205c-5f0c-48dc-93dd-ca4c6cb64996 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:32.209837 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-72cd205c-5f0c-48dc-93dd-ca4c6cb64996 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:32.218247 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-72cd205c-5f0c-48dc-93dd-ca4c6cb64996 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:32.219816 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-72cd205c-5f0c-48dc-93dd-ca4c6cb64996 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:32.221071 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-72cd205c-5f0c-48dc-93dd-ca4c6cb64996 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1738 microversion: 2.20 time: 0.205983 Aug 27 01:33:32.221937 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 319/592] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:32 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:32.363137 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-45d2e665-9565-4f3c-ab80-9c7f085a4b0a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:33:32.364144 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-45d2e665-9565-4f3c-ab80-9c7f085a4b0a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:32.370892 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-45d2e665-9565-4f3c-ab80-9c7f085a4b0a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:32.371343 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-45d2e665-9565-4f3c-ab80-9c7f085a4b0a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:32.372134 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-45d2e665-9565-4f3c-ab80-9c7f085a4b0a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:32.372570 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-45d2e665-9565-4f3c-ab80-9c7f085a4b0a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:32.399248 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.objects.instance [None req-45d2e665-9565-4f3c-ab80-9c7f085a4b0a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lazy-loading 'flavor' on Instance uuid 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 {{(pid=108756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:33:32.777765 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-45d2e665-9565-4f3c-ab80-9c7f085a4b0a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "POST /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118/action" status: 200 len: 32 microversion: 2.1 time: 0.412091 Aug 27 01:33:32.777765 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 274/593] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:33:32 2021] POST /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118/action => generated 32 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 01:33:32.782291 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-6fea2b97-0938-4dd7-a0cc-5816230554a0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:32.783189 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-6fea2b97-0938-4dd7-a0cc-5816230554a0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:32.792484 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6fea2b97-0938-4dd7-a0cc-5816230554a0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:32.793213 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6fea2b97-0938-4dd7-a0cc-5816230554a0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:32.796710 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6fea2b97-0938-4dd7-a0cc-5816230554a0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:32.797426 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6fea2b97-0938-4dd7-a0cc-5816230554a0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:32.998147 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-6fea2b97-0938-4dd7-a0cc-5816230554a0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:33.009917 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-6fea2b97-0938-4dd7-a0cc-5816230554a0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.231818 Aug 27 01:33:33.010956 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 320/594] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:32 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:33.239972 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-6f838fc7-2649-449a-938a-d48c75896420 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:33.240646 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-6f838fc7-2649-449a-938a-d48c75896420 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:33.247800 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6f838fc7-2649-449a-938a-d48c75896420 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:33.248239 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6f838fc7-2649-449a-938a-d48c75896420 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:33.249043 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6f838fc7-2649-449a-938a-d48c75896420 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:33.249478 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6f838fc7-2649-449a-938a-d48c75896420 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:33.380947 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-6f838fc7-2649-449a-938a-d48c75896420 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:33.389189 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-6f838fc7-2649-449a-938a-d48c75896420 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:33.390698 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-6f838fc7-2649-449a-938a-d48c75896420 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:33.391845 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-6f838fc7-2649-449a-938a-d48c75896420 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1738 microversion: 2.20 time: 0.156005 Aug 27 01:33:33.392407 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 275/595] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:33 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:34.027797 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-472bc7fd-72ae-4e3b-baf4-fe0b1760ab32 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:34.028633 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-472bc7fd-72ae-4e3b-baf4-fe0b1760ab32 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:34.034865 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-472bc7fd-72ae-4e3b-baf4-fe0b1760ab32 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:34.035310 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-472bc7fd-72ae-4e3b-baf4-fe0b1760ab32 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:34.036124 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-472bc7fd-72ae-4e3b-baf4-fe0b1760ab32 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:34.036616 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-472bc7fd-72ae-4e3b-baf4-fe0b1760ab32 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:34.175644 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-472bc7fd-72ae-4e3b-baf4-fe0b1760ab32 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:34.184321 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-472bc7fd-72ae-4e3b-baf4-fe0b1760ab32 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.160989 Aug 27 01:33:34.184897 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 321/596] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:34 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:34.409631 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-9fde61a5-061b-40dc-afbb-71d17a9e326f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:34.410292 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-9fde61a5-061b-40dc-afbb-71d17a9e326f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:34.416201 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9fde61a5-061b-40dc-afbb-71d17a9e326f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:34.416647 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9fde61a5-061b-40dc-afbb-71d17a9e326f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:34.419504 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9fde61a5-061b-40dc-afbb-71d17a9e326f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:34.419504 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9fde61a5-061b-40dc-afbb-71d17a9e326f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:34.541260 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-9fde61a5-061b-40dc-afbb-71d17a9e326f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:34.548808 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-9fde61a5-061b-40dc-afbb-71d17a9e326f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:34.550323 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-9fde61a5-061b-40dc-afbb-71d17a9e326f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:34.555084 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-9fde61a5-061b-40dc-afbb-71d17a9e326f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1738 microversion: 2.20 time: 0.145601 Aug 27 01:33:34.555084 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 276/597] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:34 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1738 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:35.200621 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b7d219ed-8161-4974-8c3d-b621673d43e7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:35.201250 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b7d219ed-8161-4974-8c3d-b621673d43e7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:35.207860 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b7d219ed-8161-4974-8c3d-b621673d43e7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:35.208407 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b7d219ed-8161-4974-8c3d-b621673d43e7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:35.209207 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b7d219ed-8161-4974-8c3d-b621673d43e7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:35.209642 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b7d219ed-8161-4974-8c3d-b621673d43e7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:35.341195 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-b7d219ed-8161-4974-8c3d-b621673d43e7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:35.352662 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b7d219ed-8161-4974-8c3d-b621673d43e7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.155423 Aug 27 01:33:35.357414 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 322/598] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:35 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:35.574434 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-4053edec-b113-498c-bba4-45c8f1a3ec6b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:35.575512 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-4053edec-b113-498c-bba4-45c8f1a3ec6b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:35.584618 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4053edec-b113-498c-bba4-45c8f1a3ec6b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:35.585101 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4053edec-b113-498c-bba4-45c8f1a3ec6b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:35.586817 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4053edec-b113-498c-bba4-45c8f1a3ec6b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:35.587368 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4053edec-b113-498c-bba4-45c8f1a3ec6b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:35.713551 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-4053edec-b113-498c-bba4-45c8f1a3ec6b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:35.722240 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-4053edec-b113-498c-bba4-45c8f1a3ec6b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:35.726399 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-4053edec-b113-498c-bba4-45c8f1a3ec6b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:35.726399 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-4053edec-b113-498c-bba4-45c8f1a3ec6b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1738 microversion: 2.20 time: 0.157777 Aug 27 01:33:35.726399 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 277/599] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:35 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:33:36.373850 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-16f0b116-04b2-4021-855d-83036d0ca53f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:36.373850 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-16f0b116-04b2-4021-855d-83036d0ca53f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:36.376745 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-16f0b116-04b2-4021-855d-83036d0ca53f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:36.377216 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-16f0b116-04b2-4021-855d-83036d0ca53f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:36.377974 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-16f0b116-04b2-4021-855d-83036d0ca53f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:36.378404 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-16f0b116-04b2-4021-855d-83036d0ca53f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:36.503815 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-16f0b116-04b2-4021-855d-83036d0ca53f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:36.512189 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-16f0b116-04b2-4021-855d-83036d0ca53f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.146477 Aug 27 01:33:36.512757 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 323/600] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:36 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:36.745012 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-509b36a3-5bf3-4688-8172-f602500bda1c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:36.745666 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-509b36a3-5bf3-4688-8172-f602500bda1c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:36.751514 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-509b36a3-5bf3-4688-8172-f602500bda1c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:36.751966 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-509b36a3-5bf3-4688-8172-f602500bda1c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:36.752729 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-509b36a3-5bf3-4688-8172-f602500bda1c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:36.753192 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-509b36a3-5bf3-4688-8172-f602500bda1c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:36.887200 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-509b36a3-5bf3-4688-8172-f602500bda1c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:36.897445 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-509b36a3-5bf3-4688-8172-f602500bda1c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:36.899215 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-509b36a3-5bf3-4688-8172-f602500bda1c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:36.901957 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-509b36a3-5bf3-4688-8172-f602500bda1c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1738 microversion: 2.20 time: 0.159064 Aug 27 01:33:36.902553 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 278/601] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:36 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:37.528653 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-5129f25a-851a-4be1-96ba-dca376e8002e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:37.716851 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-5129f25a-851a-4be1-96ba-dca376e8002e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:37.716851 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5129f25a-851a-4be1-96ba-dca376e8002e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:37.716851 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5129f25a-851a-4be1-96ba-dca376e8002e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:37.716851 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5129f25a-851a-4be1-96ba-dca376e8002e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:37.718044 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5129f25a-851a-4be1-96ba-dca376e8002e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:37.718044 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-5129f25a-851a-4be1-96ba-dca376e8002e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:37.718044 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-5129f25a-851a-4be1-96ba-dca376e8002e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.148506 Aug 27 01:33:37.718044 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 324/602] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:37 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:37.923075 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-097f5ad5-160e-4ad6-a935-a6b07581e69f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:37.923670 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-097f5ad5-160e-4ad6-a935-a6b07581e69f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:37.930302 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-097f5ad5-160e-4ad6-a935-a6b07581e69f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:37.930737 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-097f5ad5-160e-4ad6-a935-a6b07581e69f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:37.931488 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-097f5ad5-160e-4ad6-a935-a6b07581e69f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:37.931914 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-097f5ad5-160e-4ad6-a935-a6b07581e69f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:38.048705 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-097f5ad5-160e-4ad6-a935-a6b07581e69f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:38.056605 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-097f5ad5-160e-4ad6-a935-a6b07581e69f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:38.058118 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-097f5ad5-160e-4ad6-a935-a6b07581e69f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:38.059224 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-097f5ad5-160e-4ad6-a935-a6b07581e69f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1738 microversion: 2.20 time: 0.139808 Aug 27 01:33:38.059768 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 279/603] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:37 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1738 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:38.370980 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 01:33:38.371156 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: Fri Aug 27 01:33:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 01:33:38.690760 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-3aaa7e14-ea9e-48c1-b3d7-bf458877bb46 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:38.691376 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-3aaa7e14-ea9e-48c1-b3d7-bf458877bb46 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:38.698198 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3aaa7e14-ea9e-48c1-b3d7-bf458877bb46 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:38.698643 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3aaa7e14-ea9e-48c1-b3d7-bf458877bb46 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:38.699405 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3aaa7e14-ea9e-48c1-b3d7-bf458877bb46 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:38.699834 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3aaa7e14-ea9e-48c1-b3d7-bf458877bb46 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:38.821022 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-3aaa7e14-ea9e-48c1-b3d7-bf458877bb46 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:38.828351 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-3aaa7e14-ea9e-48c1-b3d7-bf458877bb46 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.141240 Aug 27 01:33:38.828911 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 325/604] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:38 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:39.076989 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-2d9c0de9-2f74-41f0-a6a9-ad599614ba80 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:39.077591 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-2d9c0de9-2f74-41f0-a6a9-ad599614ba80 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:39.083504 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2d9c0de9-2f74-41f0-a6a9-ad599614ba80 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:39.083947 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2d9c0de9-2f74-41f0-a6a9-ad599614ba80 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:39.084706 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2d9c0de9-2f74-41f0-a6a9-ad599614ba80 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:39.085170 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2d9c0de9-2f74-41f0-a6a9-ad599614ba80 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:39.212512 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-2d9c0de9-2f74-41f0-a6a9-ad599614ba80 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:39.221026 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-2d9c0de9-2f74-41f0-a6a9-ad599614ba80 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:39.222566 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-2d9c0de9-2f74-41f0-a6a9-ad599614ba80 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:39.223686 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-2d9c0de9-2f74-41f0-a6a9-ad599614ba80 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1720 microversion: 2.20 time: 0.150411 Aug 27 01:33:39.224227 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 280/605] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:39 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:39.845943 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-9594346f-3008-470a-9864-d65b73c7ea10 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:39.846582 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-9594346f-3008-470a-9864-d65b73c7ea10 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:39.853126 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9594346f-3008-470a-9864-d65b73c7ea10 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:39.853574 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9594346f-3008-470a-9864-d65b73c7ea10 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:39.854334 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9594346f-3008-470a-9864-d65b73c7ea10 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:39.854767 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9594346f-3008-470a-9864-d65b73c7ea10 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:39.978902 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-9594346f-3008-470a-9864-d65b73c7ea10 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:39.986545 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-9594346f-3008-470a-9864-d65b73c7ea10 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.144284 Aug 27 01:33:39.989434 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 326/606] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:39 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:40.241531 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-9f82b4ca-66a6-4bb5-b48f-f9d813ba53c2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:40.242669 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-9f82b4ca-66a6-4bb5-b48f-f9d813ba53c2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:40.248597 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9f82b4ca-66a6-4bb5-b48f-f9d813ba53c2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:40.249086 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9f82b4ca-66a6-4bb5-b48f-f9d813ba53c2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:40.249857 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9f82b4ca-66a6-4bb5-b48f-f9d813ba53c2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:40.250290 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9f82b4ca-66a6-4bb5-b48f-f9d813ba53c2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:40.411280 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-9f82b4ca-66a6-4bb5-b48f-f9d813ba53c2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:40.422918 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-9f82b4ca-66a6-4bb5-b48f-f9d813ba53c2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:40.424484 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-9f82b4ca-66a6-4bb5-b48f-f9d813ba53c2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:40.425645 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-9f82b4ca-66a6-4bb5-b48f-f9d813ba53c2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1720 microversion: 2.20 time: 0.187850 Aug 27 01:33:40.426596 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 281/607] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:40 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1720 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:41.003868 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-5716fe4d-71b8-40d9-95a2-8c913e6652b6 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:41.004476 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-5716fe4d-71b8-40d9-95a2-8c913e6652b6 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:41.011077 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5716fe4d-71b8-40d9-95a2-8c913e6652b6 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:41.011525 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5716fe4d-71b8-40d9-95a2-8c913e6652b6 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:41.012282 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5716fe4d-71b8-40d9-95a2-8c913e6652b6 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:41.012713 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5716fe4d-71b8-40d9-95a2-8c913e6652b6 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:41.131163 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-5716fe4d-71b8-40d9-95a2-8c913e6652b6 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:41.139468 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-5716fe4d-71b8-40d9-95a2-8c913e6652b6 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.139219 Aug 27 01:33:41.140017 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 327/608] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:40 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:41.443304 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-d3510c7e-8ac3-456c-becb-9c7832e35af8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:41.443901 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-d3510c7e-8ac3-456c-becb-9c7832e35af8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:41.450471 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d3510c7e-8ac3-456c-becb-9c7832e35af8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:41.450919 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d3510c7e-8ac3-456c-becb-9c7832e35af8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:41.451687 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d3510c7e-8ac3-456c-becb-9c7832e35af8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:41.452185 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d3510c7e-8ac3-456c-becb-9c7832e35af8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:41.598097 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-d3510c7e-8ac3-456c-becb-9c7832e35af8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:41.605864 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-d3510c7e-8ac3-456c-becb-9c7832e35af8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:41.607341 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-d3510c7e-8ac3-456c-becb-9c7832e35af8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:41.608453 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-d3510c7e-8ac3-456c-becb-9c7832e35af8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1720 microversion: 2.20 time: 0.168852 Aug 27 01:33:41.609021 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 282/609] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:41 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:42.156161 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-1b9d3c5f-59a2-4966-b3fc-436536058cc7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:42.156761 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-1b9d3c5f-59a2-4966-b3fc-436536058cc7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:42.162665 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1b9d3c5f-59a2-4966-b3fc-436536058cc7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:42.163106 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1b9d3c5f-59a2-4966-b3fc-436536058cc7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:42.163893 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1b9d3c5f-59a2-4966-b3fc-436536058cc7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:42.164315 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1b9d3c5f-59a2-4966-b3fc-436536058cc7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:42.310965 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-1b9d3c5f-59a2-4966-b3fc-436536058cc7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:42.318819 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-1b9d3c5f-59a2-4966-b3fc-436536058cc7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.166259 Aug 27 01:33:42.319376 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 328/610] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:42 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:42.368232 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-2eb4829c-f4a5-4704-9f93-a6f08358c046 req-f2675b10-0a82-477e-a07d-7a9214faf693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ec83298-8a1e-4edd-be07-4e0592a0ce04", "name": "network-vif-unplugged", "status": "completed", "tag": "5f7cab4d-54ba-4757-bb8d-1d2f0a14a90e"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:33:42.370059 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:33:42.370059 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:33:42.376750 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-2eb4829c-f4a5-4704-9f93-a6f08358c046 req-f2675b10-0a82-477e-a07d-7a9214faf693 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:42.377413 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-2eb4829c-f4a5-4704-9f93-a6f08358c046 req-f2675b10-0a82-477e-a07d-7a9214faf693 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:42.389079 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-2eb4829c-f4a5-4704-9f93-a6f08358c046 req-f2675b10-0a82-477e-a07d-7a9214faf693 service nova] Creating event network-vif-unplugged:5f7cab4d-54ba-4757-bb8d-1d2f0a14a90e for instance 6ec83298-8a1e-4edd-be07-4e0592a0ce04 on hv-cinder-75916 Aug 27 01:33:42.394180 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-2eb4829c-f4a5-4704-9f93-a6f08358c046 req-f2675b10-0a82-477e-a07d-7a9214faf693 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029741 Aug 27 01:33:42.394983 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 283/611] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:33:42 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:33:42.626101 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-62c4a6ac-a8df-4c6d-848f-cc2ce0ee41c7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:42.626623 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-62c4a6ac-a8df-4c6d-848f-cc2ce0ee41c7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:42.632973 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-62c4a6ac-a8df-4c6d-848f-cc2ce0ee41c7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:42.633406 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-62c4a6ac-a8df-4c6d-848f-cc2ce0ee41c7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:42.634163 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-62c4a6ac-a8df-4c6d-848f-cc2ce0ee41c7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:42.634612 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-62c4a6ac-a8df-4c6d-848f-cc2ce0ee41c7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:42.764459 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-62c4a6ac-a8df-4c6d-848f-cc2ce0ee41c7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:42.772177 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-62c4a6ac-a8df-4c6d-848f-cc2ce0ee41c7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:42.773825 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-62c4a6ac-a8df-4c6d-848f-cc2ce0ee41c7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:42.774957 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-62c4a6ac-a8df-4c6d-848f-cc2ce0ee41c7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1720 microversion: 2.20 time: 0.152690 Aug 27 01:33:42.775501 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 329/612] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:42 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:43.336469 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-468d15b4-2304-4885-8748-06847c768f21 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:43.337100 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-468d15b4-2304-4885-8748-06847c768f21 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:43.343143 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-468d15b4-2304-4885-8748-06847c768f21 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:43.343585 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-468d15b4-2304-4885-8748-06847c768f21 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:43.344344 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-468d15b4-2304-4885-8748-06847c768f21 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:43.344776 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-468d15b4-2304-4885-8748-06847c768f21 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:43.468685 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-468d15b4-2304-4885-8748-06847c768f21 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:43.477395 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-468d15b4-2304-4885-8748-06847c768f21 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.145533 Aug 27 01:33:43.477958 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 284/613] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:43 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:43.792576 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-6c7cc3a0-9841-4eb4-82d5-741832fc3ae8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:43.793203 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-6c7cc3a0-9841-4eb4-82d5-741832fc3ae8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:43.800367 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6c7cc3a0-9841-4eb4-82d5-741832fc3ae8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:43.800889 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6c7cc3a0-9841-4eb4-82d5-741832fc3ae8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:43.805938 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6c7cc3a0-9841-4eb4-82d5-741832fc3ae8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:43.805938 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6c7cc3a0-9841-4eb4-82d5-741832fc3ae8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:43.927791 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-6c7cc3a0-9841-4eb4-82d5-741832fc3ae8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:43.935833 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-6c7cc3a0-9841-4eb4-82d5-741832fc3ae8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:43.937351 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-6c7cc3a0-9841-4eb4-82d5-741832fc3ae8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:43.938660 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-6c7cc3a0-9841-4eb4-82d5-741832fc3ae8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1720 microversion: 2.20 time: 0.149764 Aug 27 01:33:43.939203 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 330/614] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:43 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:44.495003 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-df7dfaea-c41d-4557-a124-1d5d01e55a8e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:44.495405 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-df7dfaea-c41d-4557-a124-1d5d01e55a8e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:44.502582 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-df7dfaea-c41d-4557-a124-1d5d01e55a8e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:44.503025 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-df7dfaea-c41d-4557-a124-1d5d01e55a8e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:44.503872 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-df7dfaea-c41d-4557-a124-1d5d01e55a8e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:44.504300 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-df7dfaea-c41d-4557-a124-1d5d01e55a8e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:44.626912 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-df7dfaea-c41d-4557-a124-1d5d01e55a8e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:44.634947 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-df7dfaea-c41d-4557-a124-1d5d01e55a8e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.144419 Aug 27 01:33:44.635500 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 285/615] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:44 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:44.957523 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-19bffc2d-a5a8-45d7-b261-5975e810a90d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:44.958182 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-19bffc2d-a5a8-45d7-b261-5975e810a90d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:44.965548 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-19bffc2d-a5a8-45d7-b261-5975e810a90d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:44.966045 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-19bffc2d-a5a8-45d7-b261-5975e810a90d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:44.966844 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-19bffc2d-a5a8-45d7-b261-5975e810a90d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:44.967318 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-19bffc2d-a5a8-45d7-b261-5975e810a90d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:45.087964 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-19bffc2d-a5a8-45d7-b261-5975e810a90d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:45.095826 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-19bffc2d-a5a8-45d7-b261-5975e810a90d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:45.097353 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-19bffc2d-a5a8-45d7-b261-5975e810a90d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:45.098627 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-19bffc2d-a5a8-45d7-b261-5975e810a90d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1720 microversion: 2.20 time: 0.145252 Aug 27 01:33:45.099183 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 331/616] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:44 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1720 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:45.651918 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-4bd9e280-81ae-454b-8540-ba91ccf321f1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:45.652544 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-4bd9e280-81ae-454b-8540-ba91ccf321f1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:45.658469 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4bd9e280-81ae-454b-8540-ba91ccf321f1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:45.659000 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4bd9e280-81ae-454b-8540-ba91ccf321f1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:45.659723 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4bd9e280-81ae-454b-8540-ba91ccf321f1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:45.660153 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4bd9e280-81ae-454b-8540-ba91ccf321f1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:45.784904 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-4bd9e280-81ae-454b-8540-ba91ccf321f1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:45.793109 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-4bd9e280-81ae-454b-8540-ba91ccf321f1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.145450 Aug 27 01:33:45.793740 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 286/617] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:45 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:46.116974 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-c91dd7e6-9d97-47bb-8c20-fda97b508982 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:46.118088 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-c91dd7e6-9d97-47bb-8c20-fda97b508982 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:46.123803 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c91dd7e6-9d97-47bb-8c20-fda97b508982 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:46.124244 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c91dd7e6-9d97-47bb-8c20-fda97b508982 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:46.125033 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c91dd7e6-9d97-47bb-8c20-fda97b508982 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:46.125455 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c91dd7e6-9d97-47bb-8c20-fda97b508982 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:46.256216 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-c91dd7e6-9d97-47bb-8c20-fda97b508982 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:46.264176 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-c91dd7e6-9d97-47bb-8c20-fda97b508982 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:46.265692 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-c91dd7e6-9d97-47bb-8c20-fda97b508982 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:46.266812 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-c91dd7e6-9d97-47bb-8c20-fda97b508982 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1723 microversion: 2.20 time: 0.153636 Aug 27 01:33:46.267358 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 332/618] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:46 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:46.287821 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-4de1d808-48ed-4464-a337-70f0c140bae6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e03ca09f-26cd-4fd2-a172-8a17e21db14e"}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:33:46.288961 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-4de1d808-48ed-4464-a337-70f0c140bae6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:46.296043 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4de1d808-48ed-4464-a337-70f0c140bae6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:46.296580 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4de1d808-48ed-4464-a337-70f0c140bae6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:46.297273 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4de1d808-48ed-4464-a337-70f0c140bae6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:46.297781 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4de1d808-48ed-4464-a337-70f0c140bae6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:46.459735 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-bafb1014-f1bd-4cf8-977f-e204ba21f88a tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:46.460220 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-bafb1014-f1bd-4cf8-977f-e204ba21f88a tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:46.466576 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bafb1014-f1bd-4cf8-977f-e204ba21f88a tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:46.467010 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bafb1014-f1bd-4cf8-977f-e204ba21f88a tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:46.467762 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bafb1014-f1bd-4cf8-977f-e204ba21f88a tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:46.468186 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bafb1014-f1bd-4cf8-977f-e204ba21f88a tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:46.558995 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.objects.instance [None req-bafb1014-f1bd-4cf8-977f-e204ba21f88a tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lazy-loading 'services' on Instance uuid 662047f7-1502-4db9-8e45-86b77401fa0e {{(pid=108755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:33:46.759280 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-bafb1014-f1bd-4cf8-977f-e204ba21f88a tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "DELETE /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e/os-volume_attachments/6c541655-cad6-4be5-bd16-8a922d7bb391" status: 202 len: 0 microversion: 2.1 time: 0.302438 Aug 27 01:33:46.763159 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 333/619] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Aug 27 01:33:46 2021] DELETE /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e/os-volume_attachments/6c541655-cad6-4be5-bd16-8a922d7bb391 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 01:33:46.811224 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-0c948c67-34dd-49cd-b461-c8e0d590262f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:46.811914 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-0c948c67-34dd-49cd-b461-c8e0d590262f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:46.817835 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0c948c67-34dd-49cd-b461-c8e0d590262f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:46.818283 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0c948c67-34dd-49cd-b461-c8e0d590262f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:46.819045 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0c948c67-34dd-49cd-b461-c8e0d590262f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:46.819475 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0c948c67-34dd-49cd-b461-c8e0d590262f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:46.943798 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-0c948c67-34dd-49cd-b461-c8e0d590262f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:46.958856 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-0c948c67-34dd-49cd-b461-c8e0d590262f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.151633 Aug 27 01:33:46.959429 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 334/620] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:46 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:33:47.335636 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-4de1d808-48ed-4464-a337-70f0c140bae6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.051481 Aug 27 01:33:47.336250 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 287/621] 10.222.0.25 () {62 vars in 1364 bytes} [Fri Aug 27 01:33:46 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/os-volume_attachments => generated 188 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:33:47.473392 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-ffe663f5-9408-4656-8248-6ae8b1fce0cc tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:33:47.473961 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-ffe663f5-9408-4656-8248-6ae8b1fce0cc tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:47.480429 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ffe663f5-9408-4656-8248-6ae8b1fce0cc tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:47.480895 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ffe663f5-9408-4656-8248-6ae8b1fce0cc tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:47.481712 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ffe663f5-9408-4656-8248-6ae8b1fce0cc tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:47.482130 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ffe663f5-9408-4656-8248-6ae8b1fce0cc tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:47.715254 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-ffe663f5-9408-4656-8248-6ae8b1fce0cc tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action" status: 202 len: 0 microversion: 2.20 time: 0.245997 Aug 27 01:33:47.715992 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 335/622] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:33:47 2021] POST /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 01:33:47.723783 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-375b7e5d-369b-4362-8519-4b441c3daa6f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:47.724390 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-375b7e5d-369b-4362-8519-4b441c3daa6f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:47.730903 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-375b7e5d-369b-4362-8519-4b441c3daa6f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:47.731353 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-375b7e5d-369b-4362-8519-4b441c3daa6f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:47.732130 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-375b7e5d-369b-4362-8519-4b441c3daa6f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:47.732569 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-375b7e5d-369b-4362-8519-4b441c3daa6f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:47.882322 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-375b7e5d-369b-4362-8519-4b441c3daa6f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:47.891628 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-375b7e5d-369b-4362-8519-4b441c3daa6f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:47.897906 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-375b7e5d-369b-4362-8519-4b441c3daa6f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:47.900059 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-375b7e5d-369b-4362-8519-4b441c3daa6f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1749 microversion: 2.20 time: 0.178958 Aug 27 01:33:47.900670 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 288/623] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:47 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1749 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:47.975520 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-c8bc5faf-3869-4ba0-bc77-686b4e804ec4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:47.976407 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-c8bc5faf-3869-4ba0-bc77-686b4e804ec4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:47.982748 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c8bc5faf-3869-4ba0-bc77-686b4e804ec4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:47.983402 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c8bc5faf-3869-4ba0-bc77-686b4e804ec4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:47.984383 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c8bc5faf-3869-4ba0-bc77-686b4e804ec4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:47.984813 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c8bc5faf-3869-4ba0-bc77-686b4e804ec4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:48.362483 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-c8bc5faf-3869-4ba0-bc77-686b4e804ec4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:48.371095 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-c8bc5faf-3869-4ba0-bc77-686b4e804ec4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.399438 Aug 27 01:33:48.371981 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 336/624] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:47 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:48.918596 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-32c83e74-5dd4-4ee9-a358-1ce506c9a971 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:48.919830 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-32c83e74-5dd4-4ee9-a358-1ce506c9a971 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:48.938292 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-32c83e74-5dd4-4ee9-a358-1ce506c9a971 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:48.938741 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-32c83e74-5dd4-4ee9-a358-1ce506c9a971 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:48.939521 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-32c83e74-5dd4-4ee9-a358-1ce506c9a971 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:48.940054 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-32c83e74-5dd4-4ee9-a358-1ce506c9a971 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:49.103355 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-32c83e74-5dd4-4ee9-a358-1ce506c9a971 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:49.111709 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-32c83e74-5dd4-4ee9-a358-1ce506c9a971 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:49.113232 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-32c83e74-5dd4-4ee9-a358-1ce506c9a971 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:49.114366 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-32c83e74-5dd4-4ee9-a358-1ce506c9a971 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1749 microversion: 2.20 time: 0.200997 Aug 27 01:33:49.114955 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 289/625] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:48 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1749 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:49.388384 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-e927733c-956e-421d-a68b-e7dd43180e03 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:49.388997 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-e927733c-956e-421d-a68b-e7dd43180e03 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:49.395190 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e927733c-956e-421d-a68b-e7dd43180e03 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:49.395641 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e927733c-956e-421d-a68b-e7dd43180e03 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:49.396469 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e927733c-956e-421d-a68b-e7dd43180e03 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:49.396962 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e927733c-956e-421d-a68b-e7dd43180e03 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:49.520753 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-e927733c-956e-421d-a68b-e7dd43180e03 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:49.533657 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-e927733c-956e-421d-a68b-e7dd43180e03 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.147673 Aug 27 01:33:49.544671 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 337/626] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:49 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:50.132774 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-0c7c9072-5491-4b64-a458-fd46c61a1777 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:50.133734 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-0c7c9072-5491-4b64-a458-fd46c61a1777 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:50.139605 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0c7c9072-5491-4b64-a458-fd46c61a1777 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:50.140058 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0c7c9072-5491-4b64-a458-fd46c61a1777 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:50.140802 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0c7c9072-5491-4b64-a458-fd46c61a1777 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:50.141254 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0c7c9072-5491-4b64-a458-fd46c61a1777 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:50.288704 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0c7c9072-5491-4b64-a458-fd46c61a1777 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:50.307375 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0c7c9072-5491-4b64-a458-fd46c61a1777 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:50.320858 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0c7c9072-5491-4b64-a458-fd46c61a1777 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:50.320858 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-0c7c9072-5491-4b64-a458-fd46c61a1777 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1751 microversion: 2.20 time: 0.180920 Aug 27 01:33:50.320858 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 290/627] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:50 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:50.551361 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-05ba8305-504a-4364-b8b6-6e869420532e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:50.552005 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-05ba8305-504a-4364-b8b6-6e869420532e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:50.558772 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-05ba8305-504a-4364-b8b6-6e869420532e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:50.559223 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-05ba8305-504a-4364-b8b6-6e869420532e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:50.559988 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-05ba8305-504a-4364-b8b6-6e869420532e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:50.560425 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-05ba8305-504a-4364-b8b6-6e869420532e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:50.680608 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-05ba8305-504a-4364-b8b6-6e869420532e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:50.690956 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-05ba8305-504a-4364-b8b6-6e869420532e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.142045 Aug 27 01:33:50.690956 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 338/628] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:50 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:51.173633 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-413a15cf-e329-419e-a144-085500b993b8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:51.174158 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-413a15cf-e329-419e-a144-085500b993b8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:51.181132 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-413a15cf-e329-419e-a144-085500b993b8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:51.181585 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-413a15cf-e329-419e-a144-085500b993b8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:51.182353 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-413a15cf-e329-419e-a144-085500b993b8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:51.182788 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-413a15cf-e329-419e-a144-085500b993b8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:51.314871 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.objects.instance [None req-413a15cf-e329-419e-a144-085500b993b8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lazy-loading 'services' on Instance uuid fc5d2b5b-0f23-4214-b423-29eea2193d17 {{(pid=108756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:33:51.329620 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b478f36d-8404-4784-a269-8579a05b9fec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:51.334920 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b478f36d-8404-4784-a269-8579a05b9fec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:51.336945 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b478f36d-8404-4784-a269-8579a05b9fec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:51.337797 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b478f36d-8404-4784-a269-8579a05b9fec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:51.338874 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b478f36d-8404-4784-a269-8579a05b9fec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:51.341887 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b478f36d-8404-4784-a269-8579a05b9fec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:51.502107 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-b478f36d-8404-4784-a269-8579a05b9fec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:51.511325 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-b478f36d-8404-4784-a269-8579a05b9fec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:51.512873 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-b478f36d-8404-4784-a269-8579a05b9fec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:51.514023 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b478f36d-8404-4784-a269-8579a05b9fec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1751 microversion: 2.20 time: 0.189484 Aug 27 01:33:51.514569 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 339/629] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:51 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1751 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:51.526667 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-413a15cf-e329-419e-a144-085500b993b8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17/os-volume_attachments/fb3a7d67-f304-4898-9e3a-9217f44fe613" status: 202 len: 0 microversion: 2.1 time: 0.356629 Aug 27 01:33:51.527237 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 291/630] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Aug 27 01:33:51 2021] DELETE /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17/os-volume_attachments/fb3a7d67-f304-4898-9e3a-9217f44fe613 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:33:51.542010 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-a2a5c110-d115-454a-bc1c-3b770949028d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:51.543054 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-a2a5c110-d115-454a-bc1c-3b770949028d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:51.549080 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a2a5c110-d115-454a-bc1c-3b770949028d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:51.549526 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a2a5c110-d115-454a-bc1c-3b770949028d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:51.550303 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a2a5c110-d115-454a-bc1c-3b770949028d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:51.550983 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a2a5c110-d115-454a-bc1c-3b770949028d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:51.581320 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-a2a5c110-d115-454a-bc1c-3b770949028d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049588 Aug 27 01:33:51.581924 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 340/631] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:33:51 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:33:51.707775 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-d5eca45f-fe78-48ae-8643-034f2f6a933c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:51.710610 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-d5eca45f-fe78-48ae-8643-034f2f6a933c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:51.714775 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d5eca45f-fe78-48ae-8643-034f2f6a933c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:51.715221 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d5eca45f-fe78-48ae-8643-034f2f6a933c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:51.716029 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d5eca45f-fe78-48ae-8643-034f2f6a933c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:51.716459 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d5eca45f-fe78-48ae-8643-034f2f6a933c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:51.887944 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-d5eca45f-fe78-48ae-8643-034f2f6a933c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:51.895876 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-d5eca45f-fe78-48ae-8643-034f2f6a933c tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.192119 Aug 27 01:33:51.896433 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 292/632] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:51 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:52.145287 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-55c708e1-fd3d-4a07-a9d8-62602ecf6440 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:52.145770 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-55c708e1-fd3d-4a07-a9d8-62602ecf6440 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:52.151722 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-55c708e1-fd3d-4a07-a9d8-62602ecf6440 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:52.152021 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-55c708e1-fd3d-4a07-a9d8-62602ecf6440 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:52.152776 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-55c708e1-fd3d-4a07-a9d8-62602ecf6440 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:52.153241 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-55c708e1-fd3d-4a07-a9d8-62602ecf6440 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:52.183805 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-55c708e1-fd3d-4a07-a9d8-62602ecf6440 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Going to try to terminate instance {{(pid=108755) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 01:33:52.455403 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-55c708e1-fd3d-4a07-a9d8-62602ecf6440 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "DELETE /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 204 len: 0 microversion: 2.1 time: 0.313417 Aug 27 01:33:52.455985 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 341/633] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Aug 27 01:33:52 2021] DELETE /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 01:33:52.464551 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-2a0355f0-c979-47d2-85c8-8371971ea6f1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:52.465288 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-2a0355f0-c979-47d2-85c8-8371971ea6f1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:52.471589 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2a0355f0-c979-47d2-85c8-8371971ea6f1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:52.473847 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2a0355f0-c979-47d2-85c8-8371971ea6f1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:52.473847 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2a0355f0-c979-47d2-85c8-8371971ea6f1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:52.473847 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2a0355f0-c979-47d2-85c8-8371971ea6f1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:52.532022 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-bf1c47c6-953b-4c7f-a86f-5df6dd4341c3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:52.532736 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-bf1c47c6-953b-4c7f-a86f-5df6dd4341c3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:52.540503 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bf1c47c6-953b-4c7f-a86f-5df6dd4341c3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:52.541252 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bf1c47c6-953b-4c7f-a86f-5df6dd4341c3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:52.548640 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bf1c47c6-953b-4c7f-a86f-5df6dd4341c3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:52.548640 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bf1c47c6-953b-4c7f-a86f-5df6dd4341c3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:52.604739 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-2a0355f0-c979-47d2-85c8-8371971ea6f1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:52.612183 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-2a0355f0-c979-47d2-85c8-8371971ea6f1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1515 microversion: 2.1 time: 0.151793 Aug 27 01:33:52.613155 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 293/634] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:52 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:52.618564 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-eac2b3a4-7163-43bc-9c11-96fedd88a48c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:52.626456 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-eac2b3a4-7163-43bc-9c11-96fedd88a48c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:52.626456 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-eac2b3a4-7163-43bc-9c11-96fedd88a48c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:52.626456 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-eac2b3a4-7163-43bc-9c11-96fedd88a48c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:52.626875 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-eac2b3a4-7163-43bc-9c11-96fedd88a48c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:52.627307 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-eac2b3a4-7163-43bc-9c11-96fedd88a48c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:52.657191 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-eac2b3a4-7163-43bc-9c11-96fedd88a48c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042718 Aug 27 01:33:52.657762 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 294/635] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:33:52 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:33:52.677611 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-bf1c47c6-953b-4c7f-a86f-5df6dd4341c3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:52.687002 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-bf1c47c6-953b-4c7f-a86f-5df6dd4341c3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:52.688506 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-bf1c47c6-953b-4c7f-a86f-5df6dd4341c3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:52.689668 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-bf1c47c6-953b-4c7f-a86f-5df6dd4341c3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1751 microversion: 2.20 time: 0.161645 Aug 27 01:33:52.690204 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 342/636] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:52 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:52.913163 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-b6c994cb-9c1c-43a9-ae8c-f590268165d5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:52.913976 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-b6c994cb-9c1c-43a9-ae8c-f590268165d5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:52.920309 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b6c994cb-9c1c-43a9-ae8c-f590268165d5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:52.921304 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b6c994cb-9c1c-43a9-ae8c-f590268165d5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:52.921583 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b6c994cb-9c1c-43a9-ae8c-f590268165d5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:52.922033 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b6c994cb-9c1c-43a9-ae8c-f590268165d5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:53.061214 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-b6c994cb-9c1c-43a9-ae8c-f590268165d5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:53.071579 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-b6c994cb-9c1c-43a9-ae8c-f590268165d5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.162061 Aug 27 01:33:53.072666 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 295/637] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:52 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:53.630174 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-0e284bbb-ce12-43bc-a4ec-ffdd78c83f5b tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:53.630775 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-0e284bbb-ce12-43bc-a4ec-ffdd78c83f5b tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:53.636500 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0e284bbb-ce12-43bc-a4ec-ffdd78c83f5b tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:53.636973 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0e284bbb-ce12-43bc-a4ec-ffdd78c83f5b tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:53.637728 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0e284bbb-ce12-43bc-a4ec-ffdd78c83f5b tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:53.638153 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0e284bbb-ce12-43bc-a4ec-ffdd78c83f5b tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:53.667987 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-3ec4a11d-1444-45df-b6b5-12a33b7b23de tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:53.669146 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-3ec4a11d-1444-45df-b6b5-12a33b7b23de tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:53.675653 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3ec4a11d-1444-45df-b6b5-12a33b7b23de tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:53.676446 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3ec4a11d-1444-45df-b6b5-12a33b7b23de tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:53.677350 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3ec4a11d-1444-45df-b6b5-12a33b7b23de tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:53.677865 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3ec4a11d-1444-45df-b6b5-12a33b7b23de tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:53.709730 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-3ec4a11d-1444-45df-b6b5-12a33b7b23de tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045412 Aug 27 01:33:53.710276 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 296/638] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:33:53 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:33:53.715275 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-d0161f56-8ece-4d14-a154-00534f15f98e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:53.715883 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-d0161f56-8ece-4d14-a154-00534f15f98e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:53.721612 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d0161f56-8ece-4d14-a154-00534f15f98e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:53.722054 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d0161f56-8ece-4d14-a154-00534f15f98e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:53.722823 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d0161f56-8ece-4d14-a154-00534f15f98e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:53.723256 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d0161f56-8ece-4d14-a154-00534f15f98e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:53.834514 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-0e284bbb-ce12-43bc-a4ec-ffdd78c83f5b tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:53.848972 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-0e284bbb-ce12-43bc-a4ec-ffdd78c83f5b tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1515 microversion: 2.1 time: 0.219111 Aug 27 01:33:53.848972 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 343/639] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:53 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1515 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:53.849177 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-d0161f56-8ece-4d14-a154-00534f15f98e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:53.858521 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-d0161f56-8ece-4d14-a154-00534f15f98e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:53.860059 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-d0161f56-8ece-4d14-a154-00534f15f98e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:53.861251 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-d0161f56-8ece-4d14-a154-00534f15f98e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1807 microversion: 2.20 time: 0.149824 Aug 27 01:33:53.861799 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 297/640] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:53 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:33:54.091798 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d4cfa04e-c196-4b7f-b96d-7f2de4989763 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:54.092604 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d4cfa04e-c196-4b7f-b96d-7f2de4989763 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:54.098883 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d4cfa04e-c196-4b7f-b96d-7f2de4989763 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:54.099327 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d4cfa04e-c196-4b7f-b96d-7f2de4989763 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:54.100639 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d4cfa04e-c196-4b7f-b96d-7f2de4989763 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:54.100639 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d4cfa04e-c196-4b7f-b96d-7f2de4989763 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:54.297378 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d4cfa04e-c196-4b7f-b96d-7f2de4989763 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:54.306398 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d4cfa04e-c196-4b7f-b96d-7f2de4989763 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.220850 Aug 27 01:33:54.307174 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 344/641] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:54 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:54.722494 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-60e122d1-d7e9-4b82-b303-95282d142212 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:54.723607 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-60e122d1-d7e9-4b82-b303-95282d142212 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:54.729487 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-60e122d1-d7e9-4b82-b303-95282d142212 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:54.730127 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-60e122d1-d7e9-4b82-b303-95282d142212 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:54.730906 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-60e122d1-d7e9-4b82-b303-95282d142212 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:54.731337 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-60e122d1-d7e9-4b82-b303-95282d142212 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:54.763233 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-60e122d1-d7e9-4b82-b303-95282d142212 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045403 Aug 27 01:33:54.763792 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 298/642] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:33:54 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 01:33:54.862875 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-ea5fa861-4001-4284-80fd-d7d2d21b8a2b tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:54.864269 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-ea5fa861-4001-4284-80fd-d7d2d21b8a2b tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:54.870862 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ea5fa861-4001-4284-80fd-d7d2d21b8a2b tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:54.871394 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ea5fa861-4001-4284-80fd-d7d2d21b8a2b tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:54.878022 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ea5fa861-4001-4284-80fd-d7d2d21b8a2b tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:54.878022 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ea5fa861-4001-4284-80fd-d7d2d21b8a2b tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:54.879728 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-5bfd7f1b-1a96-4154-b0e7-23c440aeef7a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:54.880327 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-5bfd7f1b-1a96-4154-b0e7-23c440aeef7a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:54.886714 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5bfd7f1b-1a96-4154-b0e7-23c440aeef7a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:54.887290 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5bfd7f1b-1a96-4154-b0e7-23c440aeef7a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:54.888083 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5bfd7f1b-1a96-4154-b0e7-23c440aeef7a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:54.888595 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5bfd7f1b-1a96-4154-b0e7-23c440aeef7a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:55.014770 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-ea5fa861-4001-4284-80fd-d7d2d21b8a2b tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:55.025403 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-ea5fa861-4001-4284-80fd-d7d2d21b8a2b tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1515 microversion: 2.1 time: 0.166371 Aug 27 01:33:55.033399 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-5bfd7f1b-1a96-4154-b0e7-23c440aeef7a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:55.034665 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 345/643] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:54 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:55.044412 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-5bfd7f1b-1a96-4154-b0e7-23c440aeef7a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:55.046007 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-5bfd7f1b-1a96-4154-b0e7-23c440aeef7a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:55.047286 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-5bfd7f1b-1a96-4154-b0e7-23c440aeef7a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1807 microversion: 2.20 time: 0.171572 Aug 27 01:33:55.047756 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 299/644] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:54 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:33:55.325240 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-19bbe4da-a0b7-479c-8490-31c36c2225e5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:55.326250 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-19bbe4da-a0b7-479c-8490-31c36c2225e5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:55.332269 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-19bbe4da-a0b7-479c-8490-31c36c2225e5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:55.332979 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-19bbe4da-a0b7-479c-8490-31c36c2225e5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:55.333983 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-19bbe4da-a0b7-479c-8490-31c36c2225e5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:55.334642 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-19bbe4da-a0b7-479c-8490-31c36c2225e5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:55.476219 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-19bbe4da-a0b7-479c-8490-31c36c2225e5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:55.484913 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-19bbe4da-a0b7-479c-8490-31c36c2225e5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.165008 Aug 27 01:33:55.485555 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 346/645] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:55 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:56.042961 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-6c3ad33f-a4c5-4b21-8eab-dbe887d599fb tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:56.043520 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-6c3ad33f-a4c5-4b21-8eab-dbe887d599fb tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:56.049337 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6c3ad33f-a4c5-4b21-8eab-dbe887d599fb tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:56.050911 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6c3ad33f-a4c5-4b21-8eab-dbe887d599fb tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:56.050911 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6c3ad33f-a4c5-4b21-8eab-dbe887d599fb tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:56.051274 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6c3ad33f-a4c5-4b21-8eab-dbe887d599fb tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:56.065606 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-8c9de3c4-4e93-4b39-9c46-704481bb8990 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:56.066335 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-8c9de3c4-4e93-4b39-9c46-704481bb8990 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:56.073422 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8c9de3c4-4e93-4b39-9c46-704481bb8990 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:56.076307 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8c9de3c4-4e93-4b39-9c46-704481bb8990 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:56.076307 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8c9de3c4-4e93-4b39-9c46-704481bb8990 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:56.076307 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8c9de3c4-4e93-4b39-9c46-704481bb8990 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:56.205886 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-6c3ad33f-a4c5-4b21-8eab-dbe887d599fb tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:56.214173 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-6c3ad33f-a4c5-4b21-8eab-dbe887d599fb tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1515 microversion: 2.1 time: 0.175553 Aug 27 01:33:56.222642 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 300/646] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:56 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:56.228264 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-e6575df8-1dcb-43dc-9fff-378c19c098ce tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:56.228763 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-e6575df8-1dcb-43dc-9fff-378c19c098ce tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:56.234720 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e6575df8-1dcb-43dc-9fff-378c19c098ce tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:56.235162 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e6575df8-1dcb-43dc-9fff-378c19c098ce tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:56.235939 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e6575df8-1dcb-43dc-9fff-378c19c098ce tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:56.236373 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e6575df8-1dcb-43dc-9fff-378c19c098ce tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:56.263110 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-e6575df8-1dcb-43dc-9fff-378c19c098ce tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Going to try to terminate instance {{(pid=108756) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 01:33:56.263235 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-8c9de3c4-4e93-4b39-9c46-704481bb8990 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:56.270587 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-8c9de3c4-4e93-4b39-9c46-704481bb8990 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:56.272336 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-8c9de3c4-4e93-4b39-9c46-704481bb8990 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:56.274481 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-8c9de3c4-4e93-4b39-9c46-704481bb8990 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1807 microversion: 2.20 time: 0.211869 Aug 27 01:33:56.294103 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 347/647] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:56 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1807 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:33:56.502110 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-65baee3b-90d7-48a8-a7ca-793033fdcd59 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:56.502721 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-65baee3b-90d7-48a8-a7ca-793033fdcd59 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:56.508476 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-65baee3b-90d7-48a8-a7ca-793033fdcd59 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:56.508956 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-65baee3b-90d7-48a8-a7ca-793033fdcd59 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:56.509722 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-65baee3b-90d7-48a8-a7ca-793033fdcd59 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:56.517058 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-65baee3b-90d7-48a8-a7ca-793033fdcd59 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:56.576752 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-e6575df8-1dcb-43dc-9fff-378c19c098ce tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 204 len: 0 microversion: 2.1 time: 0.352283 Aug 27 01:33:56.577442 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 301/648] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Aug 27 01:33:56 2021] DELETE /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 01:33:56.586715 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-7732f29f-bab0-433d-9a2c-751cdba5cea5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:56.589682 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-7732f29f-bab0-433d-9a2c-751cdba5cea5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:56.595756 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7732f29f-bab0-433d-9a2c-751cdba5cea5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:56.596448 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7732f29f-bab0-433d-9a2c-751cdba5cea5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:56.597296 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7732f29f-bab0-433d-9a2c-751cdba5cea5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:56.597731 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7732f29f-bab0-433d-9a2c-751cdba5cea5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:56.656408 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-65baee3b-90d7-48a8-a7ca-793033fdcd59 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:56.665527 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-65baee3b-90d7-48a8-a7ca-793033fdcd59 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.165964 Aug 27 01:33:56.666102 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 348/649] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:56 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:33:56.726653 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-7732f29f-bab0-433d-9a2c-751cdba5cea5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:56.734317 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-7732f29f-bab0-433d-9a2c-751cdba5cea5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1513 microversion: 2.1 time: 0.152386 Aug 27 01:33:56.734872 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 302/650] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:56 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:33:57.231410 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-38a42cd7-1b6e-4e32-aa43-a0169e353234 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:57.232027 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-38a42cd7-1b6e-4e32-aa43-a0169e353234 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:57.241318 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-38a42cd7-1b6e-4e32-aa43-a0169e353234 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:57.241754 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-38a42cd7-1b6e-4e32-aa43-a0169e353234 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:57.243509 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-38a42cd7-1b6e-4e32-aa43-a0169e353234 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:57.243728 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-38a42cd7-1b6e-4e32-aa43-a0169e353234 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:57.293825 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-899aa107-1aff-4e77-ae3e-49d6857f60be tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:57.294453 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-899aa107-1aff-4e77-ae3e-49d6857f60be tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:57.300203 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-899aa107-1aff-4e77-ae3e-49d6857f60be tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:57.300931 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-899aa107-1aff-4e77-ae3e-49d6857f60be tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:57.301697 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-899aa107-1aff-4e77-ae3e-49d6857f60be tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:57.302125 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-899aa107-1aff-4e77-ae3e-49d6857f60be tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:57.389488 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-38a42cd7-1b6e-4e32-aa43-a0169e353234 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:57.399092 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-38a42cd7-1b6e-4e32-aa43-a0169e353234 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1515 microversion: 2.1 time: 0.171583 Aug 27 01:33:57.400366 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 349/651] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:57 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:57.448620 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-899aa107-1aff-4e77-ae3e-49d6857f60be tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:57.457189 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-899aa107-1aff-4e77-ae3e-49d6857f60be tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:57.458684 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-899aa107-1aff-4e77-ae3e-49d6857f60be tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:57.459817 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-899aa107-1aff-4e77-ae3e-49d6857f60be tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1807 microversion: 2.20 time: 0.169827 Aug 27 01:33:57.460363 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 303/652] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:57 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:33:57.683251 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4a612f00-6119-463e-8be8-510955a8d6a5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:57.683854 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4a612f00-6119-463e-8be8-510955a8d6a5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:57.689729 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4a612f00-6119-463e-8be8-510955a8d6a5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:57.690168 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4a612f00-6119-463e-8be8-510955a8d6a5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:57.690920 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4a612f00-6119-463e-8be8-510955a8d6a5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:57.691345 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4a612f00-6119-463e-8be8-510955a8d6a5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:57.751679 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ec23905a-aefd-47ec-bbb1-05ade89f1e51 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:57.752732 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-ec23905a-aefd-47ec-bbb1-05ade89f1e51 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:57.766676 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ec23905a-aefd-47ec-bbb1-05ade89f1e51 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:57.767679 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ec23905a-aefd-47ec-bbb1-05ade89f1e51 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:57.768281 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ec23905a-aefd-47ec-bbb1-05ade89f1e51 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:57.769069 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ec23905a-aefd-47ec-bbb1-05ade89f1e51 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:57.839243 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4a612f00-6119-463e-8be8-510955a8d6a5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:57.847745 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4a612f00-6119-463e-8be8-510955a8d6a5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.168740 Aug 27 01:33:57.848868 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 350/653] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:57 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:57.949436 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ec23905a-aefd-47ec-bbb1-05ade89f1e51 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:57.959792 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-ec23905a-aefd-47ec-bbb1-05ade89f1e51 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1513 microversion: 2.1 time: 0.212218 Aug 27 01:33:57.960717 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 304/654] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:57 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1513 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:58.423129 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-1179a555-e737-42a2-ba45-b56528b01574 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:58.424448 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-1179a555-e737-42a2-ba45-b56528b01574 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:58.432531 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1179a555-e737-42a2-ba45-b56528b01574 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:58.433325 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1179a555-e737-42a2-ba45-b56528b01574 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:58.434500 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1179a555-e737-42a2-ba45-b56528b01574 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:58.435203 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1179a555-e737-42a2-ba45-b56528b01574 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:58.478320 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-972c070b-f48f-4090-b17d-e18d8d7da171 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:58.478931 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-972c070b-f48f-4090-b17d-e18d8d7da171 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:58.484932 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-972c070b-f48f-4090-b17d-e18d8d7da171 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:58.485376 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-972c070b-f48f-4090-b17d-e18d8d7da171 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:58.486145 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-972c070b-f48f-4090-b17d-e18d8d7da171 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:58.486572 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-972c070b-f48f-4090-b17d-e18d8d7da171 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:58.568574 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-1179a555-e737-42a2-ba45-b56528b01574 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:58.577006 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-1179a555-e737-42a2-ba45-b56528b01574 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1515 microversion: 2.1 time: 0.165247 Aug 27 01:33:58.577592 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 351/655] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:58 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:58.608522 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-972c070b-f48f-4090-b17d-e18d8d7da171 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:58.616638 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-972c070b-f48f-4090-b17d-e18d8d7da171 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:58.618831 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-972c070b-f48f-4090-b17d-e18d8d7da171 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:58.619939 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-972c070b-f48f-4090-b17d-e18d8d7da171 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1807 microversion: 2.20 time: 0.145926 Aug 27 01:33:58.620479 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 305/656] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:58 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1807 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:33:58.866521 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4492d6a5-8f08-47d8-bdb6-63a3314ace7a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:58.867659 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4492d6a5-8f08-47d8-bdb6-63a3314ace7a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:58.873375 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4492d6a5-8f08-47d8-bdb6-63a3314ace7a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:58.873814 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4492d6a5-8f08-47d8-bdb6-63a3314ace7a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:58.874595 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4492d6a5-8f08-47d8-bdb6-63a3314ace7a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:58.875024 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4492d6a5-8f08-47d8-bdb6-63a3314ace7a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:58.979879 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-e493ae2e-1279-4c41-b985-5d0e57262d4e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:58.980510 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-e493ae2e-1279-4c41-b985-5d0e57262d4e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:58.993719 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e493ae2e-1279-4c41-b985-5d0e57262d4e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:59.002985 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e493ae2e-1279-4c41-b985-5d0e57262d4e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:59.005576 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e493ae2e-1279-4c41-b985-5d0e57262d4e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:59.006840 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e493ae2e-1279-4c41-b985-5d0e57262d4e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:59.079395 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4492d6a5-8f08-47d8-bdb6-63a3314ace7a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:59.087901 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4492d6a5-8f08-47d8-bdb6-63a3314ace7a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.225099 Aug 27 01:33:59.088472 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 352/657] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:58 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:59.160368 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-e493ae2e-1279-4c41-b985-5d0e57262d4e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:59.169478 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-e493ae2e-1279-4c41-b985-5d0e57262d4e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1513 microversion: 2.1 time: 0.194639 Aug 27 01:33:59.170060 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 306/658] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:58 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1513 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:33:59.433739 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-04df9c3e-70f1-4d8b-a585-124555f31adb req-1b8e50f8-169f-4374-87e6-3b1208210bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662047f7-1502-4db9-8e45-86b77401fa0e", "name": "network-vif-unplugged", "status": "completed", "tag": "b32e536e-4fa6-43eb-9d3e-e1ee00b00d98"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:33:59.435548 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:33:59.435548 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:33:59.443566 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-04df9c3e-70f1-4d8b-a585-124555f31adb req-1b8e50f8-169f-4374-87e6-3b1208210bcb service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:59.444092 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-04df9c3e-70f1-4d8b-a585-124555f31adb req-1b8e50f8-169f-4374-87e6-3b1208210bcb service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:59.456985 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-04df9c3e-70f1-4d8b-a585-124555f31adb req-1b8e50f8-169f-4374-87e6-3b1208210bcb service nova] Creating event network-vif-unplugged:b32e536e-4fa6-43eb-9d3e-e1ee00b00d98 for instance 662047f7-1502-4db9-8e45-86b77401fa0e on hv-cinder-75916 Aug 27 01:33:59.463450 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-04df9c3e-70f1-4d8b-a585-124555f31adb req-1b8e50f8-169f-4374-87e6-3b1208210bcb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034199 Aug 27 01:33:59.464414 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 353/659] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:33:59 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:33:59.595471 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-1912c646-60e9-472c-94e2-ea12bd9a29a1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:59.595471 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-1912c646-60e9-472c-94e2-ea12bd9a29a1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:59.601286 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1912c646-60e9-472c-94e2-ea12bd9a29a1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:59.602363 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1912c646-60e9-472c-94e2-ea12bd9a29a1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:59.603243 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1912c646-60e9-472c-94e2-ea12bd9a29a1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:59.603685 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1912c646-60e9-472c-94e2-ea12bd9a29a1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:59.639228 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-db743e77-8c2a-47d1-b114-103edc2b6fd1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:33:59.640485 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-db743e77-8c2a-47d1-b114-103edc2b6fd1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:33:59.649936 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-db743e77-8c2a-47d1-b114-103edc2b6fd1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:59.650756 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-db743e77-8c2a-47d1-b114-103edc2b6fd1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:59.651854 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-db743e77-8c2a-47d1-b114-103edc2b6fd1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:33:59.652446 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-db743e77-8c2a-47d1-b114-103edc2b6fd1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:33:59.763116 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-1912c646-60e9-472c-94e2-ea12bd9a29a1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:59.779305 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-1912c646-60e9-472c-94e2-ea12bd9a29a1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1515 microversion: 2.1 time: 0.188114 Aug 27 01:33:59.779427 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 307/660] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:33:59 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:33:59.835251 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-db743e77-8c2a-47d1-b114-103edc2b6fd1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:59.845684 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-db743e77-8c2a-47d1-b114-103edc2b6fd1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:59.847880 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-db743e77-8c2a-47d1-b114-103edc2b6fd1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:33:59.849356 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-db743e77-8c2a-47d1-b114-103edc2b6fd1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1807 microversion: 2.20 time: 0.214818 Aug 27 01:33:59.850554 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 354/661] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:33:59 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1807 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:34:00.117743 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-2a0fbd93-1e1a-488c-97db-4a2dd3ce9561 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:00.118471 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-2a0fbd93-1e1a-488c-97db-4a2dd3ce9561 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:00.125189 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2a0fbd93-1e1a-488c-97db-4a2dd3ce9561 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:00.125984 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2a0fbd93-1e1a-488c-97db-4a2dd3ce9561 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:00.127127 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2a0fbd93-1e1a-488c-97db-4a2dd3ce9561 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:00.127844 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2a0fbd93-1e1a-488c-97db-4a2dd3ce9561 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:00.186339 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-3d625219-bcf8-4476-b775-bfdf7aafdeb3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:00.187037 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-3d625219-bcf8-4476-b775-bfdf7aafdeb3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:00.193043 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3d625219-bcf8-4476-b775-bfdf7aafdeb3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:00.193558 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3d625219-bcf8-4476-b775-bfdf7aafdeb3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:00.194381 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3d625219-bcf8-4476-b775-bfdf7aafdeb3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:00.194876 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3d625219-bcf8-4476-b775-bfdf7aafdeb3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:00.259284 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-2a0fbd93-1e1a-488c-97db-4a2dd3ce9561 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:00.267178 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-2a0fbd93-1e1a-488c-97db-4a2dd3ce9561 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.158063 Aug 27 01:34:00.267742 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 308/662] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:00 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:00.322287 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-3d625219-bcf8-4476-b775-bfdf7aafdeb3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:00.329482 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-3d625219-bcf8-4476-b775-bfdf7aafdeb3 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1513 microversion: 2.1 time: 0.146818 Aug 27 01:34:00.330031 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 355/663] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:00 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:34:00.801328 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-461ba982-be71-41d2-b121-7b1ce011105c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:00.802013 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-461ba982-be71-41d2-b121-7b1ce011105c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:00.815167 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-461ba982-be71-41d2-b121-7b1ce011105c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:00.815167 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-461ba982-be71-41d2-b121-7b1ce011105c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:00.815167 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-461ba982-be71-41d2-b121-7b1ce011105c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:00.815167 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-461ba982-be71-41d2-b121-7b1ce011105c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:00.869685 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-ba176665-c2d3-4c75-8fb1-4c288acdf48d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:00.870535 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-ba176665-c2d3-4c75-8fb1-4c288acdf48d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:00.877598 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ba176665-c2d3-4c75-8fb1-4c288acdf48d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:00.878535 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ba176665-c2d3-4c75-8fb1-4c288acdf48d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:00.880488 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ba176665-c2d3-4c75-8fb1-4c288acdf48d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:00.881386 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ba176665-c2d3-4c75-8fb1-4c288acdf48d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:00.940817 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-461ba982-be71-41d2-b121-7b1ce011105c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:00.953527 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-461ba982-be71-41d2-b121-7b1ce011105c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1515 microversion: 2.1 time: 0.155971 Aug 27 01:34:00.954301 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 309/664] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:00 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:01.056117 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-ba176665-c2d3-4c75-8fb1-4c288acdf48d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:01.064328 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-ba176665-c2d3-4c75-8fb1-4c288acdf48d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:01.065799 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-ba176665-c2d3-4c75-8fb1-4c288acdf48d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:01.066916 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-ba176665-c2d3-4c75-8fb1-4c288acdf48d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1807 microversion: 2.20 time: 0.203203 Aug 27 01:34:01.067459 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 356/665] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:34:00 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1807 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:34:01.284923 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-7ef474ec-04d6-4b34-b0b0-123771beaee1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:01.285452 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-7ef474ec-04d6-4b34-b0b0-123771beaee1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:01.291804 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7ef474ec-04d6-4b34-b0b0-123771beaee1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:01.292921 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7ef474ec-04d6-4b34-b0b0-123771beaee1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:01.293024 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7ef474ec-04d6-4b34-b0b0-123771beaee1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:01.293453 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7ef474ec-04d6-4b34-b0b0-123771beaee1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:01.346503 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-43ba81b2-5b76-44cb-a3ee-2e3a11ca579c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:01.347294 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-43ba81b2-5b76-44cb-a3ee-2e3a11ca579c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:01.353712 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-43ba81b2-5b76-44cb-a3ee-2e3a11ca579c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:01.354152 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-43ba81b2-5b76-44cb-a3ee-2e3a11ca579c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:01.354917 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-43ba81b2-5b76-44cb-a3ee-2e3a11ca579c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:01.355351 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-43ba81b2-5b76-44cb-a3ee-2e3a11ca579c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:01.423649 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-7ef474ec-04d6-4b34-b0b0-123771beaee1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:01.433705 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-7ef474ec-04d6-4b34-b0b0-123771beaee1 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.151995 Aug 27 01:34:01.434038 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 310/666] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:01 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:01.488410 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-43ba81b2-5b76-44cb-a3ee-2e3a11ca579c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:01.496795 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-43ba81b2-5b76-44cb-a3ee-2e3a11ca579c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1513 microversion: 2.1 time: 0.153881 Aug 27 01:34:01.497663 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 357/667] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:01 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:34:01.970883 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-b01093b3-3109-49c1-9e32-a292bd5eaa9d tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:01.972393 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-b01093b3-3109-49c1-9e32-a292bd5eaa9d tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:01.981042 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b01093b3-3109-49c1-9e32-a292bd5eaa9d tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:01.981607 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b01093b3-3109-49c1-9e32-a292bd5eaa9d tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:01.982493 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b01093b3-3109-49c1-9e32-a292bd5eaa9d tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:01.983078 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b01093b3-3109-49c1-9e32-a292bd5eaa9d tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:02.084897 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-0eadbc3a-28a7-467c-a739-5c1c63c163e8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:02.085494 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-0eadbc3a-28a7-467c-a739-5c1c63c163e8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:02.091990 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0eadbc3a-28a7-467c-a739-5c1c63c163e8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:02.092441 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0eadbc3a-28a7-467c-a739-5c1c63c163e8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:02.093410 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0eadbc3a-28a7-467c-a739-5c1c63c163e8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:02.093717 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0eadbc3a-28a7-467c-a739-5c1c63c163e8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:02.121904 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-b01093b3-3109-49c1-9e32-a292bd5eaa9d tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:02.129586 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-b01093b3-3109-49c1-9e32-a292bd5eaa9d tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1515 microversion: 2.1 time: 0.162317 Aug 27 01:34:02.130157 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 311/668] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:01 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:02.233167 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-0eadbc3a-28a7-467c-a739-5c1c63c163e8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:02.241797 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-0eadbc3a-28a7-467c-a739-5c1c63c163e8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:02.243313 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-0eadbc3a-28a7-467c-a739-5c1c63c163e8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:02.245042 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-0eadbc3a-28a7-467c-a739-5c1c63c163e8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1807 microversion: 2.20 time: 0.163278 Aug 27 01:34:02.245042 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 358/669] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:34:02 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:34:02.450883 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-a5c70ade-f09e-49ce-aae6-f40179542479 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:02.451494 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-a5c70ade-f09e-49ce-aae6-f40179542479 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:02.457552 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a5c70ade-f09e-49ce-aae6-f40179542479 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:02.458000 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a5c70ade-f09e-49ce-aae6-f40179542479 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:02.458767 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a5c70ade-f09e-49ce-aae6-f40179542479 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:02.459203 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a5c70ade-f09e-49ce-aae6-f40179542479 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:02.514246 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-2a93f9c0-929b-43f3-91cf-c4cf2123fc08 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:02.514718 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-2a93f9c0-929b-43f3-91cf-c4cf2123fc08 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:02.521249 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2a93f9c0-929b-43f3-91cf-c4cf2123fc08 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:02.521723 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2a93f9c0-929b-43f3-91cf-c4cf2123fc08 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:02.522510 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2a93f9c0-929b-43f3-91cf-c4cf2123fc08 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:02.522997 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2a93f9c0-929b-43f3-91cf-c4cf2123fc08 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:02.627633 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-a5c70ade-f09e-49ce-aae6-f40179542479 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:02.637188 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-a5c70ade-f09e-49ce-aae6-f40179542479 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.189587 Aug 27 01:34:02.639577 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 312/670] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:02 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:02.663131 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-2a93f9c0-929b-43f3-91cf-c4cf2123fc08 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:02.667232 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-2a93f9c0-929b-43f3-91cf-c4cf2123fc08 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1513 microversion: 2.1 time: 0.156729 Aug 27 01:34:02.667793 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 359/671] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:02 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:34:03.146882 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-70c80671-9b95-4cbe-9cc0-7f7aaddb2e33 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:03.147517 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-70c80671-9b95-4cbe-9cc0-7f7aaddb2e33 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:03.153772 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-70c80671-9b95-4cbe-9cc0-7f7aaddb2e33 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:03.154222 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-70c80671-9b95-4cbe-9cc0-7f7aaddb2e33 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:03.155002 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-70c80671-9b95-4cbe-9cc0-7f7aaddb2e33 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:03.155430 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-70c80671-9b95-4cbe-9cc0-7f7aaddb2e33 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:03.263068 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4f205157-2b94-4e32-a35a-40c1a54545d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:03.264070 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4f205157-2b94-4e32-a35a-40c1a54545d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:03.281255 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4f205157-2b94-4e32-a35a-40c1a54545d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:03.281974 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4f205157-2b94-4e32-a35a-40c1a54545d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:03.283058 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4f205157-2b94-4e32-a35a-40c1a54545d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:03.283662 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4f205157-2b94-4e32-a35a-40c1a54545d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:03.322107 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-70c80671-9b95-4cbe-9cc0-7f7aaddb2e33 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:03.339016 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-70c80671-9b95-4cbe-9cc0-7f7aaddb2e33 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1515 microversion: 2.1 time: 0.195547 Aug 27 01:34:03.340430 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 313/672] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:03 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1515 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:03.419070 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4f205157-2b94-4e32-a35a-40c1a54545d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:03.437947 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4f205157-2b94-4e32-a35a-40c1a54545d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:03.440245 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4f205157-2b94-4e32-a35a-40c1a54545d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:03.442005 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4f205157-2b94-4e32-a35a-40c1a54545d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1807 microversion: 2.20 time: 0.182502 Aug 27 01:34:03.452958 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 360/673] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:34:03 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:34:03.656281 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-b1a7b04f-76d3-4539-bc5c-b7f81bc6568d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:03.657054 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-b1a7b04f-76d3-4539-bc5c-b7f81bc6568d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:03.663333 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b1a7b04f-76d3-4539-bc5c-b7f81bc6568d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:03.664393 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b1a7b04f-76d3-4539-bc5c-b7f81bc6568d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:03.665200 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b1a7b04f-76d3-4539-bc5c-b7f81bc6568d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:03.665625 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b1a7b04f-76d3-4539-bc5c-b7f81bc6568d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:03.683911 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d6faef0f-2382-4bb7-a405-39cc8bb769c8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:03.695426 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d6faef0f-2382-4bb7-a405-39cc8bb769c8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:03.695426 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d6faef0f-2382-4bb7-a405-39cc8bb769c8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:03.695426 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d6faef0f-2382-4bb7-a405-39cc8bb769c8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:03.695426 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d6faef0f-2382-4bb7-a405-39cc8bb769c8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:03.695838 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d6faef0f-2382-4bb7-a405-39cc8bb769c8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:03.803114 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-b1a7b04f-76d3-4539-bc5c-b7f81bc6568d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:03.812471 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-b1a7b04f-76d3-4539-bc5c-b7f81bc6568d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.160170 Aug 27 01:34:03.814030 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 314/674] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:03 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:03.844559 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d6faef0f-2382-4bb7-a405-39cc8bb769c8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:03.852247 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d6faef0f-2382-4bb7-a405-39cc8bb769c8 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1513 microversion: 2.1 time: 0.172500 Aug 27 01:34:03.856465 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 361/675] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:03 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:34:04.359038 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-5bb7f839-4164-4051-a1de-001fb67a65ca tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:04.360493 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-5bb7f839-4164-4051-a1de-001fb67a65ca tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:04.367853 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5bb7f839-4164-4051-a1de-001fb67a65ca tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:04.368295 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5bb7f839-4164-4051-a1de-001fb67a65ca tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:04.369185 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5bb7f839-4164-4051-a1de-001fb67a65ca tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:04.369665 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5bb7f839-4164-4051-a1de-001fb67a65ca tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:04.462158 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-5ea00a09-57aa-4e6d-8622-b000bb3b909d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:04.463305 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-5ea00a09-57aa-4e6d-8622-b000bb3b909d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:04.469108 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5ea00a09-57aa-4e6d-8622-b000bb3b909d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:04.469756 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5ea00a09-57aa-4e6d-8622-b000bb3b909d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:04.478191 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5ea00a09-57aa-4e6d-8622-b000bb3b909d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:04.478191 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5ea00a09-57aa-4e6d-8622-b000bb3b909d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:04.520165 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-5bb7f839-4164-4051-a1de-001fb67a65ca tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:04.531640 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-5bb7f839-4164-4051-a1de-001fb67a65ca tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1515 microversion: 2.1 time: 0.177665 Aug 27 01:34:04.533233 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 315/676] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:04 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:04.600219 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-5ea00a09-57aa-4e6d-8622-b000bb3b909d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:04.609512 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-5ea00a09-57aa-4e6d-8622-b000bb3b909d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:04.611005 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-5ea00a09-57aa-4e6d-8622-b000bb3b909d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:04.612136 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-5ea00a09-57aa-4e6d-8622-b000bb3b909d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1807 microversion: 2.20 time: 0.154328 Aug 27 01:34:04.612686 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 362/677] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:34:04 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:34:04.852004 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-e8f21bf2-99d6-4c39-a2fa-136ad23e9c36 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:04.852004 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-e8f21bf2-99d6-4c39-a2fa-136ad23e9c36 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:04.852004 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e8f21bf2-99d6-4c39-a2fa-136ad23e9c36 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:04.852004 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e8f21bf2-99d6-4c39-a2fa-136ad23e9c36 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:04.852564 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e8f21bf2-99d6-4c39-a2fa-136ad23e9c36 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:04.852564 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e8f21bf2-99d6-4c39-a2fa-136ad23e9c36 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:04.869259 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-6e868959-ab1a-4a9b-bd0e-221f09459e5f tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:04.869881 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-6e868959-ab1a-4a9b-bd0e-221f09459e5f tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:04.877296 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6e868959-ab1a-4a9b-bd0e-221f09459e5f tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:04.877746 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6e868959-ab1a-4a9b-bd0e-221f09459e5f tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:04.878512 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6e868959-ab1a-4a9b-bd0e-221f09459e5f tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:04.878940 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6e868959-ab1a-4a9b-bd0e-221f09459e5f tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:04.985758 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-e8f21bf2-99d6-4c39-a2fa-136ad23e9c36 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:04.998164 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-e8f21bf2-99d6-4c39-a2fa-136ad23e9c36 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.170402 Aug 27 01:34:05.000180 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 316/678] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:04 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:05.031703 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-6e868959-ab1a-4a9b-bd0e-221f09459e5f tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:05.041195 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-6e868959-ab1a-4a9b-bd0e-221f09459e5f tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1513 microversion: 2.1 time: 0.176606 Aug 27 01:34:05.042441 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 363/679] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:04 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:34:05.549634 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-99b04078-0f72-4adb-874d-53d59e5e4427 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:05.550231 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-99b04078-0f72-4adb-874d-53d59e5e4427 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:05.557382 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-99b04078-0f72-4adb-874d-53d59e5e4427 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:05.558044 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-99b04078-0f72-4adb-874d-53d59e5e4427 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:05.558975 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-99b04078-0f72-4adb-874d-53d59e5e4427 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:05.559554 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-99b04078-0f72-4adb-874d-53d59e5e4427 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:05.630930 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-82a75aca-a19a-47bb-ada7-f9f5d8d0751f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:05.631545 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-82a75aca-a19a-47bb-ada7-f9f5d8d0751f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:05.638120 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-82a75aca-a19a-47bb-ada7-f9f5d8d0751f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:05.640156 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-82a75aca-a19a-47bb-ada7-f9f5d8d0751f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:05.640156 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-82a75aca-a19a-47bb-ada7-f9f5d8d0751f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:05.640156 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-82a75aca-a19a-47bb-ada7-f9f5d8d0751f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:05.693936 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-99b04078-0f72-4adb-874d-53d59e5e4427 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:05.702115 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-99b04078-0f72-4adb-874d-53d59e5e4427 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1515 microversion: 2.1 time: 0.156210 Aug 27 01:34:05.702688 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 317/680] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:05 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:05.766787 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-82a75aca-a19a-47bb-ada7-f9f5d8d0751f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:05.776108 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-82a75aca-a19a-47bb-ada7-f9f5d8d0751f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:05.777699 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-82a75aca-a19a-47bb-ada7-f9f5d8d0751f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:05.778831 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-82a75aca-a19a-47bb-ada7-f9f5d8d0751f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1807 microversion: 2.20 time: 0.151612 Aug 27 01:34:05.779384 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 364/681] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:34:05 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:34:06.015338 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-5751dfff-23f9-485d-b7d8-b3afa176783f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:06.015969 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-5751dfff-23f9-485d-b7d8-b3afa176783f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:06.021872 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5751dfff-23f9-485d-b7d8-b3afa176783f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:06.022315 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5751dfff-23f9-485d-b7d8-b3afa176783f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:06.023072 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5751dfff-23f9-485d-b7d8-b3afa176783f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:06.023505 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5751dfff-23f9-485d-b7d8-b3afa176783f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:06.059723 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b85d9d4b-13a4-40fe-8f51-5cfded920f52 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:06.059723 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b85d9d4b-13a4-40fe-8f51-5cfded920f52 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:06.090969 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b85d9d4b-13a4-40fe-8f51-5cfded920f52 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:06.091485 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b85d9d4b-13a4-40fe-8f51-5cfded920f52 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:06.092526 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b85d9d4b-13a4-40fe-8f51-5cfded920f52 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:06.092936 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b85d9d4b-13a4-40fe-8f51-5cfded920f52 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:06.175563 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-5751dfff-23f9-485d-b7d8-b3afa176783f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:06.186231 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-5751dfff-23f9-485d-b7d8-b3afa176783f tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.174448 Aug 27 01:34:06.187483 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 318/682] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:06 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:06.247824 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-b85d9d4b-13a4-40fe-8f51-5cfded920f52 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:06.255403 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b85d9d4b-13a4-40fe-8f51-5cfded920f52 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1513 microversion: 2.1 time: 0.201475 Aug 27 01:34:06.255958 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 365/683] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:06 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1513 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:34:06.720035 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ea97c1b0-5657-48b1-af21-fbd7195cb9a0 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:06.720674 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-ea97c1b0-5657-48b1-af21-fbd7195cb9a0 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:06.727095 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ea97c1b0-5657-48b1-af21-fbd7195cb9a0 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:06.727607 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ea97c1b0-5657-48b1-af21-fbd7195cb9a0 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:06.728358 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ea97c1b0-5657-48b1-af21-fbd7195cb9a0 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:06.728783 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ea97c1b0-5657-48b1-af21-fbd7195cb9a0 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:06.796367 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-c21b2142-0d5a-431b-a4b5-230ae6e458a9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:06.797024 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-c21b2142-0d5a-431b-a4b5-230ae6e458a9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:06.803249 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c21b2142-0d5a-431b-a4b5-230ae6e458a9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:06.803694 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c21b2142-0d5a-431b-a4b5-230ae6e458a9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:06.805221 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c21b2142-0d5a-431b-a4b5-230ae6e458a9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:06.805615 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c21b2142-0d5a-431b-a4b5-230ae6e458a9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:06.857507 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ea97c1b0-5657-48b1-af21-fbd7195cb9a0 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:06.865782 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-ea97c1b0-5657-48b1-af21-fbd7195cb9a0 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1515 microversion: 2.1 time: 0.149402 Aug 27 01:34:06.866883 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 319/684] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:06 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:06.951144 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-c21b2142-0d5a-431b-a4b5-230ae6e458a9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:06.959386 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-c21b2142-0d5a-431b-a4b5-230ae6e458a9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:06.961463 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-c21b2142-0d5a-431b-a4b5-230ae6e458a9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:06.962584 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-c21b2142-0d5a-431b-a4b5-230ae6e458a9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1807 microversion: 2.20 time: 0.169995 Aug 27 01:34:06.963125 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 366/685] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:34:06 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:34:07.203093 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-16cf6dbe-f6ed-42de-9f4c-195227870098 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:07.203700 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-16cf6dbe-f6ed-42de-9f4c-195227870098 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:07.209535 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-16cf6dbe-f6ed-42de-9f4c-195227870098 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:07.209984 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-16cf6dbe-f6ed-42de-9f4c-195227870098 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:07.210899 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-16cf6dbe-f6ed-42de-9f4c-195227870098 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:07.211340 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-16cf6dbe-f6ed-42de-9f4c-195227870098 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:07.273050 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-03fb42c1-44f9-4f46-a473-c2ab795cc2dd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:07.274462 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-03fb42c1-44f9-4f46-a473-c2ab795cc2dd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:07.296093 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-03fb42c1-44f9-4f46-a473-c2ab795cc2dd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:07.296667 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-03fb42c1-44f9-4f46-a473-c2ab795cc2dd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:07.297465 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-03fb42c1-44f9-4f46-a473-c2ab795cc2dd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:07.297910 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-03fb42c1-44f9-4f46-a473-c2ab795cc2dd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:07.349622 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-16cf6dbe-f6ed-42de-9f4c-195227870098 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:07.358905 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-16cf6dbe-f6ed-42de-9f4c-195227870098 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.159346 Aug 27 01:34:07.359836 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 320/686] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:07 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:07.450611 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-03fb42c1-44f9-4f46-a473-c2ab795cc2dd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:07.457842 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-03fb42c1-44f9-4f46-a473-c2ab795cc2dd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1513 microversion: 2.1 time: 0.188782 Aug 27 01:34:07.458393 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 367/687] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:07 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1513 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:34:07.882483 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-54d7548e-d1ce-451d-b3cc-758a5a45c2d5 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:07.883160 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-54d7548e-d1ce-451d-b3cc-758a5a45c2d5 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:07.888811 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-54d7548e-d1ce-451d-b3cc-758a5a45c2d5 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:07.889278 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-54d7548e-d1ce-451d-b3cc-758a5a45c2d5 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:07.890074 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-54d7548e-d1ce-451d-b3cc-758a5a45c2d5 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:07.890507 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-54d7548e-d1ce-451d-b3cc-758a5a45c2d5 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:07.979047 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-83415363-b59a-4c50-9ea7-294f91e115de tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:07.979658 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-83415363-b59a-4c50-9ea7-294f91e115de tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:07.986076 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-83415363-b59a-4c50-9ea7-294f91e115de tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:07.986522 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-83415363-b59a-4c50-9ea7-294f91e115de tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:07.987296 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-83415363-b59a-4c50-9ea7-294f91e115de tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:07.987730 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-83415363-b59a-4c50-9ea7-294f91e115de tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:08.019371 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-54d7548e-d1ce-451d-b3cc-758a5a45c2d5 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:08.022435 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-54d7548e-d1ce-451d-b3cc-758a5a45c2d5 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1515 microversion: 2.1 time: 0.143560 Aug 27 01:34:08.023627 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 321/688] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:07 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1515 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:08.110134 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-83415363-b59a-4c50-9ea7-294f91e115de tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:08.118385 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-83415363-b59a-4c50-9ea7-294f91e115de tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:08.119881 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-83415363-b59a-4c50-9ea7-294f91e115de tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:08.121133 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-83415363-b59a-4c50-9ea7-294f91e115de tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1807 microversion: 2.20 time: 0.145618 Aug 27 01:34:08.121593 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 368/689] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:34:07 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1807 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:34:08.376665 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-e0710840-34f9-4aeb-9a69-21221b5dd61e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:08.377211 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-e0710840-34f9-4aeb-9a69-21221b5dd61e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:08.386159 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e0710840-34f9-4aeb-9a69-21221b5dd61e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:08.386605 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e0710840-34f9-4aeb-9a69-21221b5dd61e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:08.387378 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e0710840-34f9-4aeb-9a69-21221b5dd61e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:08.387812 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e0710840-34f9-4aeb-9a69-21221b5dd61e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:08.474794 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-67e0a159-2bd4-41c9-8c26-4bfd417e67ba tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:08.475397 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-67e0a159-2bd4-41c9-8c26-4bfd417e67ba tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:08.481521 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-67e0a159-2bd4-41c9-8c26-4bfd417e67ba tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:08.481961 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-67e0a159-2bd4-41c9-8c26-4bfd417e67ba tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:08.482728 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-67e0a159-2bd4-41c9-8c26-4bfd417e67ba tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:08.483157 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-67e0a159-2bd4-41c9-8c26-4bfd417e67ba tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:08.514265 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-e0710840-34f9-4aeb-9a69-21221b5dd61e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:08.522259 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-e0710840-34f9-4aeb-9a69-21221b5dd61e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.149362 Aug 27 01:34:08.522826 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 322/690] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:08 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:08.691780 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-67e0a159-2bd4-41c9-8c26-4bfd417e67ba tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:08.699767 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-67e0a159-2bd4-41c9-8c26-4bfd417e67ba tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1513 microversion: 2.1 time: 0.228585 Aug 27 01:34:08.700319 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 369/691] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:08 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1513 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:34:09.006357 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-07fdaada-9659-4196-8c88-127bbdfbe28a req-2fb419d3-7f83-484e-9628-234cf130249d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662047f7-1502-4db9-8e45-86b77401fa0e", "name": "network-vif-deleted", "tag": "b32e536e-4fa6-43eb-9d3e-e1ee00b00d98"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:34:09.007923 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:34:09.007923 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:34:09.018175 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-07fdaada-9659-4196-8c88-127bbdfbe28a req-2fb419d3-7f83-484e-9628-234cf130249d service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:09.018175 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-07fdaada-9659-4196-8c88-127bbdfbe28a req-2fb419d3-7f83-484e-9628-234cf130249d service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:09.026040 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-07fdaada-9659-4196-8c88-127bbdfbe28a req-2fb419d3-7f83-484e-9628-234cf130249d service nova] Creating event network-vif-deleted:b32e536e-4fa6-43eb-9d3e-e1ee00b00d98 for instance 662047f7-1502-4db9-8e45-86b77401fa0e on hv-cinder-75916 Aug 27 01:34:09.031166 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-07fdaada-9659-4196-8c88-127bbdfbe28a req-2fb419d3-7f83-484e-9628-234cf130249d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028288 Aug 27 01:34:09.031810 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 323/692] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:34:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:34:09.039857 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-9c5df12d-da85-40d1-bf35-1dc36b15b014 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:09.040497 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-9c5df12d-da85-40d1-bf35-1dc36b15b014 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:09.046289 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9c5df12d-da85-40d1-bf35-1dc36b15b014 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:09.046792 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9c5df12d-da85-40d1-bf35-1dc36b15b014 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:09.047549 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9c5df12d-da85-40d1-bf35-1dc36b15b014 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:09.047977 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9c5df12d-da85-40d1-bf35-1dc36b15b014 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:09.110679 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-9c5df12d-da85-40d1-bf35-1dc36b15b014 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:09.118024 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-9c5df12d-da85-40d1-bf35-1dc36b15b014 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 200 len: 1473 microversion: 2.1 time: 0.082437 Aug 27 01:34:09.118572 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 370/693] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:09 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 1473 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:09.139188 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-f5528ccd-ffd2-4bbf-9bb0-f42db570e30e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:09.139902 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-f5528ccd-ffd2-4bbf-9bb0-f42db570e30e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:09.146094 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f5528ccd-ffd2-4bbf-9bb0-f42db570e30e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:09.146544 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f5528ccd-ffd2-4bbf-9bb0-f42db570e30e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:09.147312 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f5528ccd-ffd2-4bbf-9bb0-f42db570e30e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:09.147768 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f5528ccd-ffd2-4bbf-9bb0-f42db570e30e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:09.277559 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-f5528ccd-ffd2-4bbf-9bb0-f42db570e30e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:09.287821 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-f5528ccd-ffd2-4bbf-9bb0-f42db570e30e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:09.289332 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-f5528ccd-ffd2-4bbf-9bb0-f42db570e30e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:09.290466 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-f5528ccd-ffd2-4bbf-9bb0-f42db570e30e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1807 microversion: 2.20 time: 0.155273 Aug 27 01:34:09.291010 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 324/694] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:34:09 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:34:09.540405 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-1c0699ce-0221-4e0f-a6f2-425b326293e4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:09.541144 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-1c0699ce-0221-4e0f-a6f2-425b326293e4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:09.547191 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1c0699ce-0221-4e0f-a6f2-425b326293e4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:09.547635 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1c0699ce-0221-4e0f-a6f2-425b326293e4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:09.548412 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1c0699ce-0221-4e0f-a6f2-425b326293e4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:09.548866 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1c0699ce-0221-4e0f-a6f2-425b326293e4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:09.717925 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-5e4e1a24-229e-47e6-8362-2832258b2f72 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:09.718629 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-5e4e1a24-229e-47e6-8362-2832258b2f72 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:09.725670 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5e4e1a24-229e-47e6-8362-2832258b2f72 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:09.726189 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5e4e1a24-229e-47e6-8362-2832258b2f72 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:09.728047 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5e4e1a24-229e-47e6-8362-2832258b2f72 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:09.728358 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5e4e1a24-229e-47e6-8362-2832258b2f72 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:09.774002 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-1c0699ce-0221-4e0f-a6f2-425b326293e4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:09.780780 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-1c0699ce-0221-4e0f-a6f2-425b326293e4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.244943 Aug 27 01:34:09.791096 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 371/695] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:09 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:09.859949 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-5e4e1a24-229e-47e6-8362-2832258b2f72 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:09.867327 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-5e4e1a24-229e-47e6-8362-2832258b2f72 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1513 microversion: 2.1 time: 0.153004 Aug 27 01:34:09.867904 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 325/696] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:09 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:34:10.135048 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-80e62f63-d578-461a-abfe-a1e4d5c87c1a tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:10.136898 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-80e62f63-d578-461a-abfe-a1e4d5c87c1a tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 662047f7-1502-4db9-8e45-86b77401fa0e] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:10.142298 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-80e62f63-d578-461a-abfe-a1e4d5c87c1a tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:10.142748 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-80e62f63-d578-461a-abfe-a1e4d5c87c1a tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:10.143513 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-80e62f63-d578-461a-abfe-a1e4d5c87c1a tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:10.143951 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-80e62f63-d578-461a-abfe-a1e4d5c87c1a tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:10.157314 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.wsgi [None req-80e62f63-d578-461a-abfe-a1e4d5c87c1a tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] HTTP exception thrown: Instance 662047f7-1502-4db9-8e45-86b77401fa0e could not be found. Aug 27 01:34:10.157905 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-80e62f63-d578-461a-abfe-a1e4d5c87c1a tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Returning 404 to user: Instance 662047f7-1502-4db9-8e45-86b77401fa0e could not be found. {{(pid=108755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:34:10.158721 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-80e62f63-d578-461a-abfe-a1e4d5c87c1a tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e" status: 404 len: 111 microversion: 2.1 time: 0.027577 Aug 27 01:34:10.159320 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 372/697] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:10 2021] GET /compute/v2.1/servers/662047f7-1502-4db9-8e45-86b77401fa0e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:34:10.310265 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c83bc1e1-0f0f-43d0-bda3-47b3118f52ab tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:10.310792 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c83bc1e1-0f0f-43d0-bda3-47b3118f52ab tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:10.316705 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c83bc1e1-0f0f-43d0-bda3-47b3118f52ab tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:10.318927 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c83bc1e1-0f0f-43d0-bda3-47b3118f52ab tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:10.318927 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c83bc1e1-0f0f-43d0-bda3-47b3118f52ab tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:10.318927 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c83bc1e1-0f0f-43d0-bda3-47b3118f52ab tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:10.654789 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c83bc1e1-0f0f-43d0-bda3-47b3118f52ab tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:10.663345 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c83bc1e1-0f0f-43d0-bda3-47b3118f52ab tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:10.665528 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c83bc1e1-0f0f-43d0-bda3-47b3118f52ab tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:10.666680 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c83bc1e1-0f0f-43d0-bda3-47b3118f52ab tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1807 microversion: 2.20 time: 0.360148 Aug 27 01:34:10.667242 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 326/698] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:34:10 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1807 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:34:10.797386 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-1047cf43-e9dc-4d88-be50-79153302ef6a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:10.798380 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-1047cf43-e9dc-4d88-be50-79153302ef6a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:10.804393 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1047cf43-e9dc-4d88-be50-79153302ef6a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:10.805288 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1047cf43-e9dc-4d88-be50-79153302ef6a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:10.806306 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1047cf43-e9dc-4d88-be50-79153302ef6a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:10.806769 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1047cf43-e9dc-4d88-be50-79153302ef6a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:10.883942 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-410a2029-4efd-4431-8ab3-915361b3527c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:10.884904 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-410a2029-4efd-4431-8ab3-915361b3527c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:10.890950 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-410a2029-4efd-4431-8ab3-915361b3527c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:10.891382 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-410a2029-4efd-4431-8ab3-915361b3527c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:10.892150 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-410a2029-4efd-4431-8ab3-915361b3527c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:10.892582 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-410a2029-4efd-4431-8ab3-915361b3527c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:10.990931 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-1047cf43-e9dc-4d88-be50-79153302ef6a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:10.999047 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-1047cf43-e9dc-4d88-be50-79153302ef6a tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.205603 Aug 27 01:34:10.999603 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 373/699] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:10 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:11.019195 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-410a2029-4efd-4431-8ab3-915361b3527c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:11.027097 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-410a2029-4efd-4431-8ab3-915361b3527c tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1513 microversion: 2.1 time: 0.146806 Aug 27 01:34:11.027655 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 327/700] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:10 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:34:11.165139 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-4418252a-eb80-4657-8ee9-1de9cd85b1e6 req-de990043-6c8e-41e1-809a-715029a7f621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc5d2b5b-0f23-4214-b423-29eea2193d17", "name": "network-vif-deleted", "tag": "f2d1dc8e-03dc-48d4-8646-8593c647e298"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:34:11.167280 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:34:11.167280 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:34:11.173978 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-4418252a-eb80-4657-8ee9-1de9cd85b1e6 req-de990043-6c8e-41e1-809a-715029a7f621 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:11.174412 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-4418252a-eb80-4657-8ee9-1de9cd85b1e6 req-de990043-6c8e-41e1-809a-715029a7f621 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:11.185851 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-4418252a-eb80-4657-8ee9-1de9cd85b1e6 req-de990043-6c8e-41e1-809a-715029a7f621 service nova] Creating event network-vif-deleted:f2d1dc8e-03dc-48d4-8646-8593c647e298 for instance fc5d2b5b-0f23-4214-b423-29eea2193d17 on hv-cinder-75916 Aug 27 01:34:11.190882 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-4418252a-eb80-4657-8ee9-1de9cd85b1e6 req-de990043-6c8e-41e1-809a-715029a7f621 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029904 Aug 27 01:34:11.192084 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 374/701] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:34:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:34:11.685738 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-6369afc2-399e-4493-8401-f4682cbb523c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:11.686753 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-6369afc2-399e-4493-8401-f4682cbb523c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:11.696328 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6369afc2-399e-4493-8401-f4682cbb523c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:11.697085 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6369afc2-399e-4493-8401-f4682cbb523c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:11.698023 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6369afc2-399e-4493-8401-f4682cbb523c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:11.698702 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6369afc2-399e-4493-8401-f4682cbb523c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:11.837011 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-6369afc2-399e-4493-8401-f4682cbb523c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:11.848074 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-6369afc2-399e-4493-8401-f4682cbb523c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:11.849626 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-6369afc2-399e-4493-8401-f4682cbb523c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:11.850814 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-6369afc2-399e-4493-8401-f4682cbb523c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1807 microversion: 2.20 time: 0.169585 Aug 27 01:34:11.851376 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 328/702] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:34:11 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:34:12.018331 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-bdc33b5c-312c-498b-a2e8-f19c0091bbec tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:12.019683 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-bdc33b5c-312c-498b-a2e8-f19c0091bbec tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:12.027412 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bdc33b5c-312c-498b-a2e8-f19c0091bbec tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:12.027860 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bdc33b5c-312c-498b-a2e8-f19c0091bbec tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:12.028624 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bdc33b5c-312c-498b-a2e8-f19c0091bbec tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:12.029085 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bdc33b5c-312c-498b-a2e8-f19c0091bbec tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:12.043806 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-8f8acc4f-1819-4a0b-ba8f-9dae3b731c6e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:12.046390 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-8f8acc4f-1819-4a0b-ba8f-9dae3b731c6e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:12.051626 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8f8acc4f-1819-4a0b-ba8f-9dae3b731c6e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:12.051854 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8f8acc4f-1819-4a0b-ba8f-9dae3b731c6e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:12.052859 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8f8acc4f-1819-4a0b-ba8f-9dae3b731c6e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:12.053307 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8f8acc4f-1819-4a0b-ba8f-9dae3b731c6e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:12.125113 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-8f8acc4f-1819-4a0b-ba8f-9dae3b731c6e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:12.132686 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-8f8acc4f-1819-4a0b-ba8f-9dae3b731c6e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1471 microversion: 2.1 time: 0.092829 Aug 27 01:34:12.134421 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 329/703] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:12 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1471 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:12.177341 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-bdc33b5c-312c-498b-a2e8-f19c0091bbec tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:12.185822 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-bdc33b5c-312c-498b-a2e8-f19c0091bbec tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.172902 Aug 27 01:34:12.186381 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 375/704] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:12 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:12.869256 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-06e2fb93-4a06-417c-a1aa-deb592d707c8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:12.869830 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-06e2fb93-4a06-417c-a1aa-deb592d707c8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:12.875646 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-06e2fb93-4a06-417c-a1aa-deb592d707c8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:12.876317 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-06e2fb93-4a06-417c-a1aa-deb592d707c8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:12.876839 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-06e2fb93-4a06-417c-a1aa-deb592d707c8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:12.877281 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-06e2fb93-4a06-417c-a1aa-deb592d707c8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:12.995262 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-06e2fb93-4a06-417c-a1aa-deb592d707c8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:13.003384 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-06e2fb93-4a06-417c-a1aa-deb592d707c8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:13.004907 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-06e2fb93-4a06-417c-a1aa-deb592d707c8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:13.006033 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-06e2fb93-4a06-417c-a1aa-deb592d707c8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1807 microversion: 2.20 time: 0.140608 Aug 27 01:34:13.006585 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 330/705] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:34:12 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1807 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:34:13.156213 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b2c8fac2-56d8-4142-a9ba-0a52c3dea4b0 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:13.156860 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b2c8fac2-56d8-4142-a9ba-0a52c3dea4b0 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:13.162726 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b2c8fac2-56d8-4142-a9ba-0a52c3dea4b0 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:13.163170 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b2c8fac2-56d8-4142-a9ba-0a52c3dea4b0 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:13.163926 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b2c8fac2-56d8-4142-a9ba-0a52c3dea4b0 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:13.164423 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b2c8fac2-56d8-4142-a9ba-0a52c3dea4b0 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:13.202508 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-23108a80-7c0b-435f-a375-333b837370bf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:13.203106 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-23108a80-7c0b-435f-a375-333b837370bf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:13.208793 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-23108a80-7c0b-435f-a375-333b837370bf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:13.209264 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-23108a80-7c0b-435f-a375-333b837370bf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:13.210083 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-23108a80-7c0b-435f-a375-333b837370bf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:13.210515 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-23108a80-7c0b-435f-a375-333b837370bf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:13.225578 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-b2c8fac2-56d8-4142-a9ba-0a52c3dea4b0 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:13.232698 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b2c8fac2-56d8-4142-a9ba-0a52c3dea4b0 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1471 microversion: 2.1 time: 0.080150 Aug 27 01:34:13.233299 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 376/706] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:13 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1471 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:13.331454 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-23108a80-7c0b-435f-a375-333b837370bf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:13.339799 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-23108a80-7c0b-435f-a375-333b837370bf tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.140981 Aug 27 01:34:13.340362 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 331/707] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:13 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:34:14.023924 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b0358bc1-1ccc-46f8-b681-ecb3c6cb09f7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:14.024470 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b0358bc1-1ccc-46f8-b681-ecb3c6cb09f7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:14.030341 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b0358bc1-1ccc-46f8-b681-ecb3c6cb09f7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:14.030775 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b0358bc1-1ccc-46f8-b681-ecb3c6cb09f7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:14.031539 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b0358bc1-1ccc-46f8-b681-ecb3c6cb09f7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:14.031973 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b0358bc1-1ccc-46f8-b681-ecb3c6cb09f7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:14.149837 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-b0358bc1-1ccc-46f8-b681-ecb3c6cb09f7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:14.157900 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-b0358bc1-1ccc-46f8-b681-ecb3c6cb09f7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:14.159413 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-b0358bc1-1ccc-46f8-b681-ecb3c6cb09f7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:14.160517 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b0358bc1-1ccc-46f8-b681-ecb3c6cb09f7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1807 microversion: 2.20 time: 0.140386 Aug 27 01:34:14.161109 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 377/708] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:34:14 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1807 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:34:14.249425 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-6dea1d92-0b4e-4791-9298-5f59d69af1bd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:14.250056 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-6dea1d92-0b4e-4791-9298-5f59d69af1bd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:14.255774 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6dea1d92-0b4e-4791-9298-5f59d69af1bd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:14.256240 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6dea1d92-0b4e-4791-9298-5f59d69af1bd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:14.257031 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6dea1d92-0b4e-4791-9298-5f59d69af1bd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:14.257461 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6dea1d92-0b4e-4791-9298-5f59d69af1bd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:14.286191 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6dea1d92-0b4e-4791-9298-5f59d69af1bd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:14.286562 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6dea1d92-0b4e-4791-9298-5f59d69af1bd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:14.287000 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.objects.instance [None req-6dea1d92-0b4e-4791-9298-5f59d69af1bd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lazy-loading 'fault' on Instance uuid fc5d2b5b-0f23-4214-b423-29eea2193d17 {{(pid=108756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:34:14.329391 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-6dea1d92-0b4e-4791-9298-5f59d69af1bd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:14.337319 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-6dea1d92-0b4e-4791-9298-5f59d69af1bd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 200 len: 1307 microversion: 2.1 time: 0.091372 Aug 27 01:34:14.337801 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 332/709] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:14 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 1307 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:34:14.357404 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4f74f0a8-09ce-4109-a80a-57bc2f42ce99 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:14.358009 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4f74f0a8-09ce-4109-a80a-57bc2f42ce99 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:14.363782 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4f74f0a8-09ce-4109-a80a-57bc2f42ce99 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:14.364221 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4f74f0a8-09ce-4109-a80a-57bc2f42ce99 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:14.365019 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4f74f0a8-09ce-4109-a80a-57bc2f42ce99 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:14.365478 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4f74f0a8-09ce-4109-a80a-57bc2f42ce99 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:14.489917 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4f74f0a8-09ce-4109-a80a-57bc2f42ce99 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:14.497792 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4f74f0a8-09ce-4109-a80a-57bc2f42ce99 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.144836 Aug 27 01:34:14.499791 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 378/710] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:14 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:34:15.179519 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-3f2da242-8584-4a99-a3a8-ac32a6a8ba31 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:15.180897 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-3f2da242-8584-4a99-a3a8-ac32a6a8ba31 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:15.186586 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3f2da242-8584-4a99-a3a8-ac32a6a8ba31 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:15.187027 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3f2da242-8584-4a99-a3a8-ac32a6a8ba31 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:15.187789 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3f2da242-8584-4a99-a3a8-ac32a6a8ba31 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:15.188232 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3f2da242-8584-4a99-a3a8-ac32a6a8ba31 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:15.310450 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-3f2da242-8584-4a99-a3a8-ac32a6a8ba31 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:15.318554 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-3f2da242-8584-4a99-a3a8-ac32a6a8ba31 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:15.320051 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-3f2da242-8584-4a99-a3a8-ac32a6a8ba31 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:15.321845 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-3f2da242-8584-4a99-a3a8-ac32a6a8ba31 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1807 microversion: 2.20 time: 0.146382 Aug 27 01:34:15.322631 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 333/711] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:34:15 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1807 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:34:15.353176 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-e76b2551-14b4-42a3-96f1-b4c6a4681b07 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:15.353807 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-e76b2551-14b4-42a3-96f1-b4c6a4681b07 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: fc5d2b5b-0f23-4214-b423-29eea2193d17] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:15.359599 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e76b2551-14b4-42a3-96f1-b4c6a4681b07 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:15.360141 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e76b2551-14b4-42a3-96f1-b4c6a4681b07 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:15.360794 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e76b2551-14b4-42a3-96f1-b4c6a4681b07 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:15.361277 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e76b2551-14b4-42a3-96f1-b4c6a4681b07 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:15.375111 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.wsgi [None req-e76b2551-14b4-42a3-96f1-b4c6a4681b07 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] HTTP exception thrown: Instance fc5d2b5b-0f23-4214-b423-29eea2193d17 could not be found. Aug 27 01:34:15.375689 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-e76b2551-14b4-42a3-96f1-b4c6a4681b07 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Returning 404 to user: Instance fc5d2b5b-0f23-4214-b423-29eea2193d17 could not be found. {{(pid=108755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:34:15.376485 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-e76b2551-14b4-42a3-96f1-b4c6a4681b07 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17" status: 404 len: 111 microversion: 2.1 time: 0.027075 Aug 27 01:34:15.377023 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 379/712] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:15 2021] GET /compute/v2.1/servers/fc5d2b5b-0f23-4214-b423-29eea2193d17 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 01:34:15.514111 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-59530a60-9ff5-4051-a347-dd324a8c024d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:15.514716 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-59530a60-9ff5-4051-a347-dd324a8c024d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:15.520695 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-59530a60-9ff5-4051-a347-dd324a8c024d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:15.521118 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-59530a60-9ff5-4051-a347-dd324a8c024d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:15.521880 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-59530a60-9ff5-4051-a347-dd324a8c024d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:15.522309 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-59530a60-9ff5-4051-a347-dd324a8c024d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:15.650371 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-59530a60-9ff5-4051-a347-dd324a8c024d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:15.658168 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-59530a60-9ff5-4051-a347-dd324a8c024d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.147774 Aug 27 01:34:15.658721 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 334/713] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:15 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:16.340279 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-9da6e78a-b216-4b38-beee-25664d5cc0da tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:16.340804 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-9da6e78a-b216-4b38-beee-25664d5cc0da tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:16.346581 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9da6e78a-b216-4b38-beee-25664d5cc0da tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:16.347036 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9da6e78a-b216-4b38-beee-25664d5cc0da tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:16.348463 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9da6e78a-b216-4b38-beee-25664d5cc0da tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:16.349162 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9da6e78a-b216-4b38-beee-25664d5cc0da tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:16.495002 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-9da6e78a-b216-4b38-beee-25664d5cc0da tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:16.504679 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-9da6e78a-b216-4b38-beee-25664d5cc0da tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:16.506195 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-9da6e78a-b216-4b38-beee-25664d5cc0da tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:16.507309 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-9da6e78a-b216-4b38-beee-25664d5cc0da tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1807 microversion: 2.20 time: 0.171525 Aug 27 01:34:16.507850 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 380/714] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:34:16 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:34:16.648607 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-5b8d5646-6666-4b8b-a974-4901d92cda05 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:16.649873 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-5b8d5646-6666-4b8b-a974-4901d92cda05 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:16.655585 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5b8d5646-6666-4b8b-a974-4901d92cda05 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:16.656029 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5b8d5646-6666-4b8b-a974-4901d92cda05 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:16.656797 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5b8d5646-6666-4b8b-a974-4901d92cda05 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:16.657255 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5b8d5646-6666-4b8b-a974-4901d92cda05 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:16.675547 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-0b3b3962-6815-4c76-a53e-1c06e29511c5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:16.676259 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-0b3b3962-6815-4c76-a53e-1c06e29511c5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:16.681409 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-5b8d5646-6666-4b8b-a974-4901d92cda05 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Going to try to terminate instance {{(pid=108756) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 01:34:16.682010 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0b3b3962-6815-4c76-a53e-1c06e29511c5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:16.682455 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0b3b3962-6815-4c76-a53e-1c06e29511c5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:16.683220 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0b3b3962-6815-4c76-a53e-1c06e29511c5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:16.683649 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0b3b3962-6815-4c76-a53e-1c06e29511c5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:16.802699 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-0b3b3962-6815-4c76-a53e-1c06e29511c5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:16.810752 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-0b3b3962-6815-4c76-a53e-1c06e29511c5 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.139086 Aug 27 01:34:16.811399 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 381/715] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:16 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:34:16.964322 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-5b8d5646-6666-4b8b-a974-4901d92cda05 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06" status: 204 len: 0 microversion: 2.1 time: 0.319004 Aug 27 01:34:16.964946 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 335/716] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Aug 27 01:34:16 2021] DELETE /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 01:34:16.972570 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-033f5456-4d5f-4b1b-90f6-54a5af73cf26 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:16.973231 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-033f5456-4d5f-4b1b-90f6-54a5af73cf26 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:16.979769 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-033f5456-4d5f-4b1b-90f6-54a5af73cf26 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:16.980206 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-033f5456-4d5f-4b1b-90f6-54a5af73cf26 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:16.980991 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-033f5456-4d5f-4b1b-90f6-54a5af73cf26 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:16.981416 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-033f5456-4d5f-4b1b-90f6-54a5af73cf26 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:17.102891 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-033f5456-4d5f-4b1b-90f6-54a5af73cf26 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:17.110073 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-033f5456-4d5f-4b1b-90f6-54a5af73cf26 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06" status: 200 len: 1514 microversion: 2.1 time: 0.141067 Aug 27 01:34:17.110630 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 382/717] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:16 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06 => generated 1514 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:17.527053 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-1b7b8e78-3f19-4c9f-8c32-b3525d7a8de4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:17.527742 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-1b7b8e78-3f19-4c9f-8c32-b3525d7a8de4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:17.533611 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1b7b8e78-3f19-4c9f-8c32-b3525d7a8de4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:17.534057 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1b7b8e78-3f19-4c9f-8c32-b3525d7a8de4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:17.534816 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1b7b8e78-3f19-4c9f-8c32-b3525d7a8de4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:17.535253 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1b7b8e78-3f19-4c9f-8c32-b3525d7a8de4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:17.653671 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-1b7b8e78-3f19-4c9f-8c32-b3525d7a8de4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:17.661920 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-1b7b8e78-3f19-4c9f-8c32-b3525d7a8de4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:17.663409 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-1b7b8e78-3f19-4c9f-8c32-b3525d7a8de4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:17.664590 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-1b7b8e78-3f19-4c9f-8c32-b3525d7a8de4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1807 microversion: 2.20 time: 0.142157 Aug 27 01:34:17.665175 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 336/718] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:34:17 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1807 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:34:17.827492 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-6a992e5d-055e-416b-a9b1-62ce8a6601b9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:17.828097 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-6a992e5d-055e-416b-a9b1-62ce8a6601b9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:17.834038 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6a992e5d-055e-416b-a9b1-62ce8a6601b9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:17.834516 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6a992e5d-055e-416b-a9b1-62ce8a6601b9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:17.835275 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6a992e5d-055e-416b-a9b1-62ce8a6601b9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:17.835704 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6a992e5d-055e-416b-a9b1-62ce8a6601b9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:17.955798 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-6a992e5d-055e-416b-a9b1-62ce8a6601b9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:17.964357 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-6a992e5d-055e-416b-a9b1-62ce8a6601b9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.140604 Aug 27 01:34:17.964925 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 383/719] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:17 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:18.127121 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-a3692373-2198-4a4f-b1ce-b9709d555f82 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:18.127714 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-a3692373-2198-4a4f-b1ce-b9709d555f82 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:18.134061 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a3692373-2198-4a4f-b1ce-b9709d555f82 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:18.134507 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a3692373-2198-4a4f-b1ce-b9709d555f82 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:18.135246 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a3692373-2198-4a4f-b1ce-b9709d555f82 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:18.135679 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a3692373-2198-4a4f-b1ce-b9709d555f82 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:18.256404 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-a3692373-2198-4a4f-b1ce-b9709d555f82 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:18.264198 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-a3692373-2198-4a4f-b1ce-b9709d555f82 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06" status: 200 len: 1514 microversion: 2.1 time: 0.140712 Aug 27 01:34:18.264746 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 337/720] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:18 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06 => generated 1514 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:18.683040 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d149f3d7-8f29-4973-91b5-96bbc0a981fa tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:18.683673 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d149f3d7-8f29-4973-91b5-96bbc0a981fa tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:18.689591 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d149f3d7-8f29-4973-91b5-96bbc0a981fa tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:18.690041 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d149f3d7-8f29-4973-91b5-96bbc0a981fa tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:18.690810 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d149f3d7-8f29-4973-91b5-96bbc0a981fa tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:18.691249 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d149f3d7-8f29-4973-91b5-96bbc0a981fa tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:18.808572 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d149f3d7-8f29-4973-91b5-96bbc0a981fa tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:18.816666 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d149f3d7-8f29-4973-91b5-96bbc0a981fa tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:18.818178 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d149f3d7-8f29-4973-91b5-96bbc0a981fa tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:18.820192 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d149f3d7-8f29-4973-91b5-96bbc0a981fa tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1807 microversion: 2.20 time: 0.140517 Aug 27 01:34:18.820192 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 384/721] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:34:18 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1807 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:34:18.981453 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-d2fc6985-531a-40a6-aaa7-1ee47b6f3530 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:18.981962 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-d2fc6985-531a-40a6-aaa7-1ee47b6f3530 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:18.987679 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d2fc6985-531a-40a6-aaa7-1ee47b6f3530 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:18.988122 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d2fc6985-531a-40a6-aaa7-1ee47b6f3530 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:18.988893 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d2fc6985-531a-40a6-aaa7-1ee47b6f3530 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:18.989322 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d2fc6985-531a-40a6-aaa7-1ee47b6f3530 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:19.109012 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-d2fc6985-531a-40a6-aaa7-1ee47b6f3530 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:19.116604 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-d2fc6985-531a-40a6-aaa7-1ee47b6f3530 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.139496 Aug 27 01:34:19.117181 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 338/722] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:18 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:19.280778 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-448392ad-8603-4dc1-9ca8-61458744bdcd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:19.281331 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-448392ad-8603-4dc1-9ca8-61458744bdcd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:19.287089 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-448392ad-8603-4dc1-9ca8-61458744bdcd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:19.287524 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-448392ad-8603-4dc1-9ca8-61458744bdcd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:19.288274 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-448392ad-8603-4dc1-9ca8-61458744bdcd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:19.288698 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-448392ad-8603-4dc1-9ca8-61458744bdcd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:19.416568 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-448392ad-8603-4dc1-9ca8-61458744bdcd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:19.423946 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-448392ad-8603-4dc1-9ca8-61458744bdcd tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06" status: 200 len: 1514 microversion: 2.1 time: 0.146833 Aug 27 01:34:19.424499 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 385/723] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:19 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:19.838815 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-d79ebd09-dd9a-4a99-9f6e-2018ec70d1b1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:19.839417 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-d79ebd09-dd9a-4a99-9f6e-2018ec70d1b1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:19.845309 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d79ebd09-dd9a-4a99-9f6e-2018ec70d1b1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:19.846710 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d79ebd09-dd9a-4a99-9f6e-2018ec70d1b1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:19.846710 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d79ebd09-dd9a-4a99-9f6e-2018ec70d1b1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:19.846983 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d79ebd09-dd9a-4a99-9f6e-2018ec70d1b1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:19.964822 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-d79ebd09-dd9a-4a99-9f6e-2018ec70d1b1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:19.973772 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-d79ebd09-dd9a-4a99-9f6e-2018ec70d1b1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:19.975284 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-d79ebd09-dd9a-4a99-9f6e-2018ec70d1b1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:19.976405 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-d79ebd09-dd9a-4a99-9f6e-2018ec70d1b1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1807 microversion: 2.20 time: 0.142236 Aug 27 01:34:19.977035 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 339/724] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:34:19 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1807 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:34:20.134317 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-74e12049-32c4-4a40-b7e8-20c9a7738af0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:20.134918 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-74e12049-32c4-4a40-b7e8-20c9a7738af0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:20.140678 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-74e12049-32c4-4a40-b7e8-20c9a7738af0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:20.141153 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-74e12049-32c4-4a40-b7e8-20c9a7738af0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:20.141905 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-74e12049-32c4-4a40-b7e8-20c9a7738af0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:20.142333 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-74e12049-32c4-4a40-b7e8-20c9a7738af0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:20.260134 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-74e12049-32c4-4a40-b7e8-20c9a7738af0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:20.267707 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-74e12049-32c4-4a40-b7e8-20c9a7738af0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.137725 Aug 27 01:34:20.268256 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 386/725] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:20 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:20.441184 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ddba662a-bb0b-4020-b7e4-cf0f8930ffe7 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:20.441787 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-ddba662a-bb0b-4020-b7e4-cf0f8930ffe7 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:20.447895 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ddba662a-bb0b-4020-b7e4-cf0f8930ffe7 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:20.448339 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ddba662a-bb0b-4020-b7e4-cf0f8930ffe7 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:20.449125 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ddba662a-bb0b-4020-b7e4-cf0f8930ffe7 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:20.449586 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ddba662a-bb0b-4020-b7e4-cf0f8930ffe7 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:20.570756 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b6caad47-a352-428f-b41d-768d7234fdb8 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2081242468", "imageRef": "6660bea6-dee9-43b4-95ef-29b53e1a2b28", "flavorRef": "452", "networks": [{"uuid": "6798e174-42c2-4b00-8cdd-a750c850a0c6"}]}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:34:20.575295 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ddba662a-bb0b-4020-b7e4-cf0f8930ffe7 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:20.582794 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-ddba662a-bb0b-4020-b7e4-cf0f8930ffe7 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06" status: 200 len: 1514 microversion: 2.1 time: 0.145088 Aug 27 01:34:20.583364 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 340/726] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:20 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06 => generated 1514 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:20.622849 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.network.neutron [None req-b6caad47-a352-428f-b41d-768d7234fdb8 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] validate_networks() for [('6798e174-42c2-4b00-8cdd-a750c850a0c6', None, None, None, None, None)] {{(pid=108755) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 01:34:20.991986 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.virt.hardware [None req-b6caad47-a352-428f-b41d-768d7234fdb8 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Flavor limits 0:0:0 {{(pid=108755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 01:34:20.992400 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.virt.hardware [None req-b6caad47-a352-428f-b41d-768d7234fdb8 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Image limits 0:0:0 {{(pid=108755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 01:34:20.992891 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.virt.hardware [None req-b6caad47-a352-428f-b41d-768d7234fdb8 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Flavor pref 0:0:0 {{(pid=108755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 01:34:20.993295 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.virt.hardware [None req-b6caad47-a352-428f-b41d-768d7234fdb8 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Image pref 0:0:0 {{(pid=108755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 01:34:20.993693 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.virt.hardware [None req-b6caad47-a352-428f-b41d-768d7234fdb8 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 01:34:20.994137 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-1cad649a-78ce-44ab-95b0-a6736b0ae340 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:20.994777 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-1cad649a-78ce-44ab-95b0-a6736b0ae340 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:21.000707 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1cad649a-78ce-44ab-95b0-a6736b0ae340 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:21.001489 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1cad649a-78ce-44ab-95b0-a6736b0ae340 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:21.002269 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1cad649a-78ce-44ab-95b0-a6736b0ae340 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:21.002474 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b6caad47-a352-428f-b41d-768d7234fdb8 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:21.002705 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1cad649a-78ce-44ab-95b0-a6736b0ae340 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:21.003714 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b6caad47-a352-428f-b41d-768d7234fdb8 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:21.003714 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b6caad47-a352-428f-b41d-768d7234fdb8 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:21.004269 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b6caad47-a352-428f-b41d-768d7234fdb8 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:21.024316 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-b6caad47-a352-428f-b41d-768d7234fdb8 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Getting quotas for project b0342a0d1e3b49c29852c11d8aeadb6f. Resources: {'ram', 'instances', 'cores'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:34:21.028421 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-b6caad47-a352-428f-b41d-768d7234fdb8 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Getting quotas for user 76bcad9416ea4ffd966b9827246ef936 and project b0342a0d1e3b49c29852c11d8aeadb6f. Resources: {'ram', 'instances', 'cores'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:34:21.039909 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b6caad47-a352-428f-b41d-768d7234fdb8 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Going to run 1 instances... {{(pid=108755) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 01:34:21.042261 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b6caad47-a352-428f-b41d-768d7234fdb8 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 3c494433-2508-45e2-8373-13c34a7c565e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6660bea6-dee9-43b4-95ef-29b53e1a2b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 01:34:21.124817 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-1cad649a-78ce-44ab-95b0-a6736b0ae340 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:21.133710 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-1cad649a-78ce-44ab-95b0-a6736b0ae340 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:21.135201 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-1cad649a-78ce-44ab-95b0-a6736b0ae340 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:21.136363 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-1cad649a-78ce-44ab-95b0-a6736b0ae340 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1807 microversion: 2.20 time: 0.145848 Aug 27 01:34:21.136884 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 341/727] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:34:20 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1807 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:34:21.164595 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b6caad47-a352-428f-b41d-768d7234fdb8 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597452 Aug 27 01:34:21.165282 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 387/728] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Aug 27 01:34:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 01:34:21.177798 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-e5ee3966-9321-42fa-912c-41f7e92d761f tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:21.179007 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-e5ee3966-9321-42fa-912c-41f7e92d761f tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 3c494433-2508-45e2-8373-13c34a7c565e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:21.231523 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-e5ee3966-9321-42fa-912c-41f7e92d761f tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:21.237927 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-e5ee3966-9321-42fa-912c-41f7e92d761f tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e" status: 200 len: 1219 microversion: 2.1 time: 0.066749 Aug 27 01:34:21.238478 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 342/729] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:21 2021] GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:21.284542 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-457cbc1b-14fe-402d-9844-9d0475fb934b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:21.285199 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-457cbc1b-14fe-402d-9844-9d0475fb934b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:21.291406 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-457cbc1b-14fe-402d-9844-9d0475fb934b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:21.291904 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-457cbc1b-14fe-402d-9844-9d0475fb934b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:21.292725 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-457cbc1b-14fe-402d-9844-9d0475fb934b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:21.293203 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-457cbc1b-14fe-402d-9844-9d0475fb934b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:21.423870 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-457cbc1b-14fe-402d-9844-9d0475fb934b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:21.433387 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-457cbc1b-14fe-402d-9844-9d0475fb934b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.152473 Aug 27 01:34:21.433948 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 388/730] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:21 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:21.599306 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-4b3e76d5-5b7a-4519-b979-3b611f3dd39e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:21.599903 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-4b3e76d5-5b7a-4519-b979-3b611f3dd39e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:21.605792 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4b3e76d5-5b7a-4519-b979-3b611f3dd39e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:21.606242 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4b3e76d5-5b7a-4519-b979-3b611f3dd39e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:21.607005 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4b3e76d5-5b7a-4519-b979-3b611f3dd39e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:21.607433 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4b3e76d5-5b7a-4519-b979-3b611f3dd39e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:21.733934 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-4b3e76d5-5b7a-4519-b979-3b611f3dd39e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:21.741284 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-4b3e76d5-5b7a-4519-b979-3b611f3dd39e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06" status: 200 len: 1514 microversion: 2.1 time: 0.145512 Aug 27 01:34:21.744875 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 343/731] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:21 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06 => generated 1514 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:21.928179 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-adf61201-07e6-49a2-9da2-dc869cce386d req-d9c8dd6f-dadd-444f-963c-865b5fe6db59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ec83298-8a1e-4edd-be07-4e0592a0ce04", "name": "network-vif-plugged", "status": "completed", "tag": "5f7cab4d-54ba-4757-bb8d-1d2f0a14a90e"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:34:21.930646 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:34:21.930646 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:34:21.955010 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-adf61201-07e6-49a2-9da2-dc869cce386d req-d9c8dd6f-dadd-444f-963c-865b5fe6db59 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:21.955588 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-adf61201-07e6-49a2-9da2-dc869cce386d req-d9c8dd6f-dadd-444f-963c-865b5fe6db59 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:21.968128 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-adf61201-07e6-49a2-9da2-dc869cce386d req-d9c8dd6f-dadd-444f-963c-865b5fe6db59 service nova] Creating event network-vif-plugged:5f7cab4d-54ba-4757-bb8d-1d2f0a14a90e for instance 6ec83298-8a1e-4edd-be07-4e0592a0ce04 on hv-cinder-75916 Aug 27 01:34:21.973258 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-adf61201-07e6-49a2-9da2-dc869cce386d req-d9c8dd6f-dadd-444f-963c-865b5fe6db59 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049696 Aug 27 01:34:21.973836 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 389/732] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:34:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:34:22.155543 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-0666b9b0-2a07-4e7b-bac4-49d56b4b3f98 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:22.156339 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-0666b9b0-2a07-4e7b-bac4-49d56b4b3f98 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:22.162278 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0666b9b0-2a07-4e7b-bac4-49d56b4b3f98 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:22.162728 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0666b9b0-2a07-4e7b-bac4-49d56b4b3f98 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:22.165351 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0666b9b0-2a07-4e7b-bac4-49d56b4b3f98 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:22.165351 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0666b9b0-2a07-4e7b-bac4-49d56b4b3f98 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:22.259252 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-bd8f6a50-1f80-4d9e-ab12-afa086b87a39 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:22.260340 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-bd8f6a50-1f80-4d9e-ab12-afa086b87a39 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 3c494433-2508-45e2-8373-13c34a7c565e] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:22.267672 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bd8f6a50-1f80-4d9e-ab12-afa086b87a39 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:22.268457 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bd8f6a50-1f80-4d9e-ab12-afa086b87a39 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:22.269661 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bd8f6a50-1f80-4d9e-ab12-afa086b87a39 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:22.274005 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bd8f6a50-1f80-4d9e-ab12-afa086b87a39 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:22.337223 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0666b9b0-2a07-4e7b-bac4-49d56b4b3f98 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:22.345753 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-bd8f6a50-1f80-4d9e-ab12-afa086b87a39 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:22.353546 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0666b9b0-2a07-4e7b-bac4-49d56b4b3f98 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:22.355267 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0666b9b0-2a07-4e7b-bac4-49d56b4b3f98 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:22.355423 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-bd8f6a50-1f80-4d9e-ab12-afa086b87a39 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e" status: 200 len: 1215 microversion: 2.1 time: 0.104286 Aug 27 01:34:22.361774 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 390/733] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:22 2021] GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e => generated 1215 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:22.361957 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-0666b9b0-2a07-4e7b-bac4-49d56b4b3f98 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1807 microversion: 2.20 time: 0.208183 Aug 27 01:34:22.361957 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 344/734] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:34:22 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1807 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:34:22.366005 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-f3235fa2-d9fb-42e8-b39c-029d5a55046f req-3c61b96d-e886-4bce-b462-5d0d96f44510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5609c94a-0725-49da-a8dc-07496ea55d06", "name": "network-vif-deleted", "tag": "313048b0-3d74-4d3f-af39-cfb37676bde6"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:34:22.373588 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:34:22.373588 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:34:22.380860 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-f3235fa2-d9fb-42e8-b39c-029d5a55046f req-3c61b96d-e886-4bce-b462-5d0d96f44510 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:22.382936 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-f3235fa2-d9fb-42e8-b39c-029d5a55046f req-3c61b96d-e886-4bce-b462-5d0d96f44510 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:22.393136 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-f3235fa2-d9fb-42e8-b39c-029d5a55046f req-3c61b96d-e886-4bce-b462-5d0d96f44510 service nova] Creating event network-vif-deleted:313048b0-3d74-4d3f-af39-cfb37676bde6 for instance 5609c94a-0725-49da-a8dc-07496ea55d06 on hv-cinder-75916 Aug 27 01:34:22.398040 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-f3235fa2-d9fb-42e8-b39c-029d5a55046f req-3c61b96d-e886-4bce-b462-5d0d96f44510 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040477 Aug 27 01:34:22.399036 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 391/735] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:34:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:34:22.450805 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-21053fc4-7ced-4504-8a35-e14c32c202b7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:22.451574 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-21053fc4-7ced-4504-8a35-e14c32c202b7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:22.468382 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-21053fc4-7ced-4504-8a35-e14c32c202b7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:22.469029 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-21053fc4-7ced-4504-8a35-e14c32c202b7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:22.469720 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-21053fc4-7ced-4504-8a35-e14c32c202b7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:22.470162 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-21053fc4-7ced-4504-8a35-e14c32c202b7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:22.604133 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-21053fc4-7ced-4504-8a35-e14c32c202b7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:22.612972 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-21053fc4-7ced-4504-8a35-e14c32c202b7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1567 microversion: 2.1 time: 0.165393 Aug 27 01:34:22.622950 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 345/736] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:22 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:22.759213 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-9b224611-07be-481a-8fa1-4fc1e129771d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:22.760051 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-9b224611-07be-481a-8fa1-4fc1e129771d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:22.766135 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9b224611-07be-481a-8fa1-4fc1e129771d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:22.766855 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9b224611-07be-481a-8fa1-4fc1e129771d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:22.767657 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9b224611-07be-481a-8fa1-4fc1e129771d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:22.768097 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9b224611-07be-481a-8fa1-4fc1e129771d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:22.799500 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9b224611-07be-481a-8fa1-4fc1e129771d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:22.799947 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9b224611-07be-481a-8fa1-4fc1e129771d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:22.800669 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.objects.instance [None req-9b224611-07be-481a-8fa1-4fc1e129771d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lazy-loading 'fault' on Instance uuid 5609c94a-0725-49da-a8dc-07496ea55d06 {{(pid=108755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:34:22.842394 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-9b224611-07be-481a-8fa1-4fc1e129771d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:22.849721 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-9b224611-07be-481a-8fa1-4fc1e129771d tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06" status: 200 len: 1308 microversion: 2.1 time: 0.094878 Aug 27 01:34:22.850309 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 392/737] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:22 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:23.372130 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-92e3fa52-06ea-4c02-86b2-86a6bdb57403 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:23.373123 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-92e3fa52-06ea-4c02-86b2-86a6bdb57403 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 3c494433-2508-45e2-8373-13c34a7c565e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:23.377969 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-117c4562-8d45-4341-a6c3-608c47b53c5b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:23.379019 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-92e3fa52-06ea-4c02-86b2-86a6bdb57403 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:23.379189 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-117c4562-8d45-4341-a6c3-608c47b53c5b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:23.379755 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-92e3fa52-06ea-4c02-86b2-86a6bdb57403 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:23.380530 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-92e3fa52-06ea-4c02-86b2-86a6bdb57403 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:23.381176 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-92e3fa52-06ea-4c02-86b2-86a6bdb57403 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:23.386450 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-117c4562-8d45-4341-a6c3-608c47b53c5b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:23.386974 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-117c4562-8d45-4341-a6c3-608c47b53c5b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:23.387774 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-117c4562-8d45-4341-a6c3-608c47b53c5b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:23.388206 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-117c4562-8d45-4341-a6c3-608c47b53c5b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:23.449842 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-92e3fa52-06ea-4c02-86b2-86a6bdb57403 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:23.457422 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-92e3fa52-06ea-4c02-86b2-86a6bdb57403 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e" status: 200 len: 1279 microversion: 2.1 time: 0.089024 Aug 27 01:34:23.458353 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 346/738] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:23 2021] GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e => generated 1279 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:23.631507 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-a79bb7ff-45a1-46c9-960c-3497eaabc6ff tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:23.632139 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-a79bb7ff-45a1-46c9-960c-3497eaabc6ff tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:23.638703 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a79bb7ff-45a1-46c9-960c-3497eaabc6ff tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:23.639150 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a79bb7ff-45a1-46c9-960c-3497eaabc6ff tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:23.639920 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a79bb7ff-45a1-46c9-960c-3497eaabc6ff tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:23.640347 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a79bb7ff-45a1-46c9-960c-3497eaabc6ff tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:23.840329 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-117c4562-8d45-4341-a6c3-608c47b53c5b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:23.850015 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-117c4562-8d45-4341-a6c3-608c47b53c5b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:23.851686 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-117c4562-8d45-4341-a6c3-608c47b53c5b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:23.857981 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-117c4562-8d45-4341-a6c3-608c47b53c5b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1807 microversion: 2.20 time: 0.480657 Aug 27 01:34:23.865887 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 393/739] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:34:23 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1807 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:34:23.872296 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-a9c57bae-b8ff-4a07-9fba-153c228dfb2a tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:23.873149 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-a9c57bae-b8ff-4a07-9fba-153c228dfb2a tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:23.884102 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a9c57bae-b8ff-4a07-9fba-153c228dfb2a tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:23.884618 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a9c57bae-b8ff-4a07-9fba-153c228dfb2a tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:23.896985 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a9c57bae-b8ff-4a07-9fba-153c228dfb2a tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:23.899324 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a9c57bae-b8ff-4a07-9fba-153c228dfb2a tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:23.953571 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a9c57bae-b8ff-4a07-9fba-153c228dfb2a tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:23.953571 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a9c57bae-b8ff-4a07-9fba-153c228dfb2a tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:23.954137 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.objects.instance [None req-a9c57bae-b8ff-4a07-9fba-153c228dfb2a tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lazy-loading 'fault' on Instance uuid 5609c94a-0725-49da-a8dc-07496ea55d06 {{(pid=108755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:34:23.986572 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-a79bb7ff-45a1-46c9-960c-3497eaabc6ff tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:23.995726 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-a79bb7ff-45a1-46c9-960c-3497eaabc6ff tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1547 microversion: 2.1 time: 0.367951 Aug 27 01:34:23.996751 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 347/740] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:23 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1547 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:34:24.012310 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-3c3abb28-5ec3-4254-a400-3412140aa578 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:24.012793 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-3c3abb28-5ec3-4254-a400-3412140aa578 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:24.018621 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3c3abb28-5ec3-4254-a400-3412140aa578 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:24.019083 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3c3abb28-5ec3-4254-a400-3412140aa578 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:24.019853 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3c3abb28-5ec3-4254-a400-3412140aa578 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:24.020278 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3c3abb28-5ec3-4254-a400-3412140aa578 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:24.026223 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-a9c57bae-b8ff-4a07-9fba-153c228dfb2a tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:24.033914 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-a9c57bae-b8ff-4a07-9fba-153c228dfb2a tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06" status: 200 len: 1308 microversion: 2.1 time: 0.166751 Aug 27 01:34:24.034609 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 394/741] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:23 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06 => generated 1308 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:24.115197 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.wsgi [None req-3c3abb28-5ec3-4254-a400-3412140aa578 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] HTTP exception thrown: Cannot 'detach_volume' instance 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 while it is in vm_state rescued Aug 27 01:34:24.117040 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-3c3abb28-5ec3-4254-a400-3412140aa578 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Returning 409 to user: Cannot 'detach_volume' instance 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 while it is in vm_state rescued {{(pid=108756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:34:24.126520 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-3c3abb28-5ec3-4254-a400-3412140aa578 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118/os-volume_attachments/97327331-ac2b-4efb-89e5-46fc5cc8c13c" status: 409 len: 152 microversion: 2.1 time: 0.118229 Aug 27 01:34:24.128114 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 348/742] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Aug 27 01:34:24 2021] DELETE /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118/os-volume_attachments/97327331-ac2b-4efb-89e5-46fc5cc8c13c => generated 152 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 27 01:34:24.150578 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-55c39248-6da8-4abe-9a41-1937e4936290 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:34:24.150578 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-55c39248-6da8-4abe-9a41-1937e4936290 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:24.150578 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-55c39248-6da8-4abe-9a41-1937e4936290 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:24.150578 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-55c39248-6da8-4abe-9a41-1937e4936290 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:24.151052 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-55c39248-6da8-4abe-9a41-1937e4936290 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:24.151052 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-55c39248-6da8-4abe-9a41-1937e4936290 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:24.473120 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-55c39248-6da8-4abe-9a41-1937e4936290 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "POST /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118/action" status: 202 len: 0 microversion: 2.1 time: 0.338046 Aug 27 01:34:24.473120 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 395/743] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:34:24 2021] POST /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 01:34:24.479966 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b8757e94-c87d-420b-8a90-2423cf9b3493 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:24.480961 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b8757e94-c87d-420b-8a90-2423cf9b3493 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:24.486026 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-000eb42f-4260-4cc9-b1aa-df488ba97c40 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:24.488613 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-000eb42f-4260-4cc9-b1aa-df488ba97c40 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 3c494433-2508-45e2-8373-13c34a7c565e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:24.489616 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b8757e94-c87d-420b-8a90-2423cf9b3493 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:24.490125 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b8757e94-c87d-420b-8a90-2423cf9b3493 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:24.490973 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b8757e94-c87d-420b-8a90-2423cf9b3493 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:24.491795 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b8757e94-c87d-420b-8a90-2423cf9b3493 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:24.498302 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-000eb42f-4260-4cc9-b1aa-df488ba97c40 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:24.498983 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-000eb42f-4260-4cc9-b1aa-df488ba97c40 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:24.499771 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-000eb42f-4260-4cc9-b1aa-df488ba97c40 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:24.500267 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-000eb42f-4260-4cc9-b1aa-df488ba97c40 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:24.565045 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-000eb42f-4260-4cc9-b1aa-df488ba97c40 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:24.573777 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-000eb42f-4260-4cc9-b1aa-df488ba97c40 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e" status: 200 len: 1277 microversion: 2.1 time: 0.098712 Aug 27 01:34:24.575282 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 349/744] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:24 2021] GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e => generated 1277 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:34:24.800818 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-b8757e94-c87d-420b-8a90-2423cf9b3493 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:24.810490 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b8757e94-c87d-420b-8a90-2423cf9b3493 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1555 microversion: 2.1 time: 0.335173 Aug 27 01:34:24.811065 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 396/745] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:24 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1555 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:24.873043 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c1d8ef51-e3d2-423e-9f90-265245464608 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:24.873649 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c1d8ef51-e3d2-423e-9f90-265245464608 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:24.879737 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c1d8ef51-e3d2-423e-9f90-265245464608 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:24.880184 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c1d8ef51-e3d2-423e-9f90-265245464608 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:24.880981 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c1d8ef51-e3d2-423e-9f90-265245464608 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:24.887447 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c1d8ef51-e3d2-423e-9f90-265245464608 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:25.000778 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c1d8ef51-e3d2-423e-9f90-265245464608 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:25.010693 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c1d8ef51-e3d2-423e-9f90-265245464608 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:25.013218 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c1d8ef51-e3d2-423e-9f90-265245464608 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:25.014368 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c1d8ef51-e3d2-423e-9f90-265245464608 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1807 microversion: 2.20 time: 0.145037 Aug 27 01:34:25.014921 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 350/746] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:34:24 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1807 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:34:25.052758 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-bff45193-918c-4665-975c-a702e0efccbb tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:25.053525 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-bff45193-918c-4665-975c-a702e0efccbb tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 5609c94a-0725-49da-a8dc-07496ea55d06] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:25.060565 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bff45193-918c-4665-975c-a702e0efccbb tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:25.061340 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bff45193-918c-4665-975c-a702e0efccbb tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:25.062104 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bff45193-918c-4665-975c-a702e0efccbb tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:25.062569 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bff45193-918c-4665-975c-a702e0efccbb tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:25.076388 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.wsgi [None req-bff45193-918c-4665-975c-a702e0efccbb tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] HTTP exception thrown: Instance 5609c94a-0725-49da-a8dc-07496ea55d06 could not be found. Aug 27 01:34:25.077019 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-bff45193-918c-4665-975c-a702e0efccbb tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Returning 404 to user: Instance 5609c94a-0725-49da-a8dc-07496ea55d06 could not be found. {{(pid=108755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:34:25.077844 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-bff45193-918c-4665-975c-a702e0efccbb tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06" status: 404 len: 111 microversion: 2.1 time: 0.030356 Aug 27 01:34:25.078383 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 397/747] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:25 2021] GET /compute/v2.1/servers/5609c94a-0725-49da-a8dc-07496ea55d06 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:34:25.086365 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-4a1c4ae1-fb99-47e4-b646-0e05018309fc tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:25.086924 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-4a1c4ae1-fb99-47e4-b646-0e05018309fc tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 6e8afedf-7eb5-446f-a22d-1412c3a11039] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:25.092890 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4a1c4ae1-fb99-47e4-b646-0e05018309fc tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:25.097418 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4a1c4ae1-fb99-47e4-b646-0e05018309fc tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:25.097418 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4a1c4ae1-fb99-47e4-b646-0e05018309fc tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:25.097418 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4a1c4ae1-fb99-47e4-b646-0e05018309fc tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:25.121198 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-4a1c4ae1-fb99-47e4-b646-0e05018309fc tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 6e8afedf-7eb5-446f-a22d-1412c3a11039] Going to try to terminate instance {{(pid=108756) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 01:34:25.495265 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-4a1c4ae1-fb99-47e4-b646-0e05018309fc tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039" status: 204 len: 0 microversion: 2.1 time: 0.412224 Aug 27 01:34:25.495958 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 351/748] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Aug 27 01:34:25 2021] DELETE /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 01:34:25.503591 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-991c69ee-e7c5-49f8-9795-29409ded8acb tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:25.504191 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-991c69ee-e7c5-49f8-9795-29409ded8acb tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 6e8afedf-7eb5-446f-a22d-1412c3a11039] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:25.511144 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-991c69ee-e7c5-49f8-9795-29409ded8acb tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:25.512156 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-991c69ee-e7c5-49f8-9795-29409ded8acb tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:25.513259 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-991c69ee-e7c5-49f8-9795-29409ded8acb tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:25.514158 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-991c69ee-e7c5-49f8-9795-29409ded8acb tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:25.598016 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c4de0670-a545-4b5f-9dd2-f964de3802f1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:25.598739 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c4de0670-a545-4b5f-9dd2-f964de3802f1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 3c494433-2508-45e2-8373-13c34a7c565e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:25.606426 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c4de0670-a545-4b5f-9dd2-f964de3802f1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:25.607019 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c4de0670-a545-4b5f-9dd2-f964de3802f1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:25.617111 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c4de0670-a545-4b5f-9dd2-f964de3802f1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:25.618141 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c4de0670-a545-4b5f-9dd2-f964de3802f1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:25.763271 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-991c69ee-e7c5-49f8-9795-29409ded8acb tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:25.766035 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c4de0670-a545-4b5f-9dd2-f964de3802f1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:25.772083 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-991c69ee-e7c5-49f8-9795-29409ded8acb tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039" status: 200 len: 1515 microversion: 2.1 time: 0.272090 Aug 27 01:34:25.773013 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 398/749] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:25 2021] GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039 => generated 1515 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:25.773126 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c4de0670-a545-4b5f-9dd2-f964de3802f1 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e" status: 200 len: 1319 microversion: 2.1 time: 0.179405 Aug 27 01:34:25.782874 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 352/750] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:25 2021] GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:34:25.863490 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-90551f58-7f94-4913-b22a-955245a01c95 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:25.864102 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-90551f58-7f94-4913-b22a-955245a01c95 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:25.870159 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-90551f58-7f94-4913-b22a-955245a01c95 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:25.870610 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-90551f58-7f94-4913-b22a-955245a01c95 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:25.871397 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-90551f58-7f94-4913-b22a-955245a01c95 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:25.871817 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-90551f58-7f94-4913-b22a-955245a01c95 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:26.027931 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-8551d896-1434-4b4f-84e3-619021f3c063 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:26.028633 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-8551d896-1434-4b4f-84e3-619021f3c063 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:26.034529 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8551d896-1434-4b4f-84e3-619021f3c063 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:26.035054 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8551d896-1434-4b4f-84e3-619021f3c063 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:26.035898 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8551d896-1434-4b4f-84e3-619021f3c063 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:26.036399 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8551d896-1434-4b4f-84e3-619021f3c063 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:26.099792 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-90551f58-7f94-4913-b22a-955245a01c95 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:26.108252 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-90551f58-7f94-4913-b22a-955245a01c95 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1555 microversion: 2.1 time: 0.248487 Aug 27 01:34:26.116905 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 399/751] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:25 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1555 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:26.123801 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.objects.instance [None req-8551d896-1434-4b4f-84e3-619021f3c063 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lazy-loading 'services' on Instance uuid be807b17-abdc-4d79-b58d-b42998cdb479 {{(pid=108756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:34:26.126462 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-dd190cab-309b-497d-818f-64a2e711d80c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:26.127332 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-dd190cab-309b-497d-818f-64a2e711d80c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:26.134093 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-dd190cab-309b-497d-818f-64a2e711d80c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:26.134706 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-dd190cab-309b-497d-818f-64a2e711d80c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:26.136044 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-dd190cab-309b-497d-818f-64a2e711d80c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:26.136162 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-dd190cab-309b-497d-818f-64a2e711d80c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:26.296559 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-dd190cab-309b-497d-818f-64a2e711d80c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:26.305999 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-dd190cab-309b-497d-818f-64a2e711d80c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:26.307572 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-dd190cab-309b-497d-818f-64a2e711d80c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:26.308716 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-dd190cab-309b-497d-818f-64a2e711d80c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1807 microversion: 2.20 time: 0.187818 Aug 27 01:34:26.309300 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 400/752] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:34:26 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:34:26.386704 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-8551d896-1434-4b4f-84e3-619021f3c063 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "DELETE /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/os-volume_attachments/162671e3-424c-4947-a56f-f3f04a085f71" status: 202 len: 0 microversion: 2.1 time: 0.361754 Aug 27 01:34:26.386804 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 353/753] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Aug 27 01:34:26 2021] DELETE /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/os-volume_attachments/162671e3-424c-4947-a56f-f3f04a085f71 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 01:34:26.404547 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-fa02f562-1a30-4e7d-af79-03677a04bf7f req-ba4efc89-67fb-4dd1-8304-ce7f7f391f1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c494433-2508-45e2-8373-13c34a7c565e", "tag": "2c66452a-5d7b-476f-b9bc-f96d7b0ab669"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:34:26.408880 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:34:26.408880 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:34:26.424207 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-fa02f562-1a30-4e7d-af79-03677a04bf7f req-ba4efc89-67fb-4dd1-8304-ce7f7f391f1e service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:26.428370 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-fa02f562-1a30-4e7d-af79-03677a04bf7f req-ba4efc89-67fb-4dd1-8304-ce7f7f391f1e service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:26.438373 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-fa02f562-1a30-4e7d-af79-03677a04bf7f req-ba4efc89-67fb-4dd1-8304-ce7f7f391f1e service nova] Creating event network-changed:2c66452a-5d7b-476f-b9bc-f96d7b0ab669 for instance 3c494433-2508-45e2-8373-13c34a7c565e on hv-cinder-75916 Aug 27 01:34:26.443801 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-fa02f562-1a30-4e7d-af79-03677a04bf7f req-ba4efc89-67fb-4dd1-8304-ce7f7f391f1e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048568 Aug 27 01:34:26.444865 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 401/754] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:34:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:34:26.791097 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-33f7499c-5435-424c-ad77-c0b7372e90e3 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:26.791715 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-db58b516-7408-4625-96c1-4567ada97926 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:26.792156 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-db58b516-7408-4625-96c1-4567ada97926 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 6e8afedf-7eb5-446f-a22d-1412c3a11039] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:26.792499 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-33f7499c-5435-424c-ad77-c0b7372e90e3 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 3c494433-2508-45e2-8373-13c34a7c565e] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:26.798377 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-db58b516-7408-4625-96c1-4567ada97926 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:26.798775 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-33f7499c-5435-424c-ad77-c0b7372e90e3 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:26.798885 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-db58b516-7408-4625-96c1-4567ada97926 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:26.799222 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-33f7499c-5435-424c-ad77-c0b7372e90e3 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:26.799599 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-db58b516-7408-4625-96c1-4567ada97926 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:26.799978 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-33f7499c-5435-424c-ad77-c0b7372e90e3 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:26.800352 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-db58b516-7408-4625-96c1-4567ada97926 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:26.801849 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-33f7499c-5435-424c-ad77-c0b7372e90e3 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:26.923945 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-db58b516-7408-4625-96c1-4567ada97926 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:26.932017 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-db58b516-7408-4625-96c1-4567ada97926 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039" status: 200 len: 1515 microversion: 2.1 time: 0.145039 Aug 27 01:34:26.932578 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 354/755] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:26 2021] GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039 => generated 1515 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:26.951781 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-33f7499c-5435-424c-ad77-c0b7372e90e3 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:26.959016 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-33f7499c-5435-424c-ad77-c0b7372e90e3 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e" status: 200 len: 1319 microversion: 2.1 time: 0.172016 Aug 27 01:34:26.959574 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 402/756] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:26 2021] GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:34:27.125900 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-7c27a51e-f578-48f6-99bb-0851009629c6 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:27.126495 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-7c27a51e-f578-48f6-99bb-0851009629c6 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:27.132676 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7c27a51e-f578-48f6-99bb-0851009629c6 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:27.133262 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7c27a51e-f578-48f6-99bb-0851009629c6 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:27.134067 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7c27a51e-f578-48f6-99bb-0851009629c6 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:27.134496 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7c27a51e-f578-48f6-99bb-0851009629c6 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:27.254179 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-7c27a51e-f578-48f6-99bb-0851009629c6 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:27.262390 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-7c27a51e-f578-48f6-99bb-0851009629c6 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1555 microversion: 2.1 time: 0.140115 Aug 27 01:34:27.262959 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 355/757] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:27 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1555 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:27.326821 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-c9223d22-7806-462d-b14f-abe2e19c8fc0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:27.327472 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-c9223d22-7806-462d-b14f-abe2e19c8fc0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:27.333141 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c9223d22-7806-462d-b14f-abe2e19c8fc0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:27.333581 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c9223d22-7806-462d-b14f-abe2e19c8fc0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:27.334335 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c9223d22-7806-462d-b14f-abe2e19c8fc0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:27.334763 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c9223d22-7806-462d-b14f-abe2e19c8fc0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:27.456135 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-c9223d22-7806-462d-b14f-abe2e19c8fc0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:27.465433 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-c9223d22-7806-462d-b14f-abe2e19c8fc0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:27.467670 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-c9223d22-7806-462d-b14f-abe2e19c8fc0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:27.468802 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-c9223d22-7806-462d-b14f-abe2e19c8fc0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1794 microversion: 2.20 time: 0.145643 Aug 27 01:34:27.469612 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 403/758] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:34:27 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1794 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:34:27.949357 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-40c4ffbc-57c4-4864-bedd-c4b49ae6df51 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:27.950046 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-40c4ffbc-57c4-4864-bedd-c4b49ae6df51 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 6e8afedf-7eb5-446f-a22d-1412c3a11039] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:27.955936 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-40c4ffbc-57c4-4864-bedd-c4b49ae6df51 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:27.956462 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-40c4ffbc-57c4-4864-bedd-c4b49ae6df51 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:27.957262 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-40c4ffbc-57c4-4864-bedd-c4b49ae6df51 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:27.957689 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-40c4ffbc-57c4-4864-bedd-c4b49ae6df51 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:27.975507 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-a3d11a09-21bb-4c05-a60c-33ff490e2ff5 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:27.977727 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-a3d11a09-21bb-4c05-a60c-33ff490e2ff5 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 3c494433-2508-45e2-8373-13c34a7c565e] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:27.984132 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a3d11a09-21bb-4c05-a60c-33ff490e2ff5 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:27.984904 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a3d11a09-21bb-4c05-a60c-33ff490e2ff5 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:27.985951 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a3d11a09-21bb-4c05-a60c-33ff490e2ff5 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:27.986644 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a3d11a09-21bb-4c05-a60c-33ff490e2ff5 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:28.095352 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-40c4ffbc-57c4-4864-bedd-c4b49ae6df51 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:28.099473 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-40c4ffbc-57c4-4864-bedd-c4b49ae6df51 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039" status: 200 len: 1515 microversion: 2.1 time: 0.153779 Aug 27 01:34:28.100696 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 356/759] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:27 2021] GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:28.215230 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-a3d11a09-21bb-4c05-a60c-33ff490e2ff5 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:28.222385 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-a3d11a09-21bb-4c05-a60c-33ff490e2ff5 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e" status: 200 len: 1319 microversion: 2.1 time: 0.250774 Aug 27 01:34:28.222939 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 404/760] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:27 2021] GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:34:28.279948 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-eb2b348d-e2dc-4675-83ff-d0ddcfdc3121 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:28.280643 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-eb2b348d-e2dc-4675-83ff-d0ddcfdc3121 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:28.286466 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-eb2b348d-e2dc-4675-83ff-d0ddcfdc3121 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:28.286911 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-eb2b348d-e2dc-4675-83ff-d0ddcfdc3121 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:28.287764 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-eb2b348d-e2dc-4675-83ff-d0ddcfdc3121 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:28.288200 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-eb2b348d-e2dc-4675-83ff-d0ddcfdc3121 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:28.409703 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-eb2b348d-e2dc-4675-83ff-d0ddcfdc3121 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:28.417978 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-eb2b348d-e2dc-4675-83ff-d0ddcfdc3121 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1561 microversion: 2.1 time: 0.141792 Aug 27 01:34:28.418765 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 357/761] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:28 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1561 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:28.489678 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4c58240c-dc9a-4a26-a08b-0a35f071d6e9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:28.490276 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4c58240c-dc9a-4a26-a08b-0a35f071d6e9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:28.496245 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4c58240c-dc9a-4a26-a08b-0a35f071d6e9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:28.496759 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4c58240c-dc9a-4a26-a08b-0a35f071d6e9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:28.497794 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4c58240c-dc9a-4a26-a08b-0a35f071d6e9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:28.498226 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4c58240c-dc9a-4a26-a08b-0a35f071d6e9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:28.569339 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-1b5526eb-6e1c-4d05-b6f8-49c96246ad89 req-38912c9e-3cc0-41fc-a426-1cc1e63ba294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e8afedf-7eb5-446f-a22d-1412c3a11039", "name": "network-vif-deleted", "tag": "cd19f281-5f24-4728-b09e-57bb575f8a48"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:34:28.571436 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:34:28.571436 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:34:28.578615 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-1b5526eb-6e1c-4d05-b6f8-49c96246ad89 req-38912c9e-3cc0-41fc-a426-1cc1e63ba294 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:28.579709 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-1b5526eb-6e1c-4d05-b6f8-49c96246ad89 req-38912c9e-3cc0-41fc-a426-1cc1e63ba294 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:28.592212 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-1b5526eb-6e1c-4d05-b6f8-49c96246ad89 req-38912c9e-3cc0-41fc-a426-1cc1e63ba294 service nova] Creating event network-vif-deleted:cd19f281-5f24-4728-b09e-57bb575f8a48 for instance 6e8afedf-7eb5-446f-a22d-1412c3a11039 on hv-cinder-75916 Aug 27 01:34:28.597346 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-1b5526eb-6e1c-4d05-b6f8-49c96246ad89 req-38912c9e-3cc0-41fc-a426-1cc1e63ba294 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031471 Aug 27 01:34:28.598492 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 358/762] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:34:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:34:28.604003 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-6f8f519c-cefd-40a9-8f56-d80edb0f59d8 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:34:28.610392 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6f8f519c-cefd-40a9-8f56-d80edb0f59d8 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:28.614478 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6f8f519c-cefd-40a9-8f56-d80edb0f59d8 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:28.614595 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.objects.instance [None req-4c58240c-dc9a-4a26-a08b-0a35f071d6e9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lazy-loading 'services' on Instance uuid 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 {{(pid=108755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:34:28.637543 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-6f8f519c-cefd-40a9-8f56-d80edb0f59d8 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Going to try to stop instance {{(pid=108756) force_stop /opt/stack/nova/nova/compute/api.py:2615}} Aug 27 01:34:28.909646 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-6f8f519c-cefd-40a9-8f56-d80edb0f59d8 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 202 len: 0 microversion: 2.1 time: 0.309454 Aug 27 01:34:28.910271 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 359/763] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:34:28 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:34:28.910766 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4c58240c-dc9a-4a26-a08b-0a35f071d6e9 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118/os-volume_attachments/97327331-ac2b-4efb-89e5-46fc5cc8c13c" status: 202 len: 0 microversion: 2.1 time: 0.424723 Aug 27 01:34:28.911475 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 405/764] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Aug 27 01:34:28 2021] DELETE /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118/os-volume_attachments/97327331-ac2b-4efb-89e5-46fc5cc8c13c => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:34:28.919814 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-d777ecf8-6404-4396-8127-d8ef8cad0487 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:28.920572 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-d777ecf8-6404-4396-8127-d8ef8cad0487 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:28.924532 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-60fb9a33-afb8-4aa8-8414-204ef0602977 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:28.926104 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-60fb9a33-afb8-4aa8-8414-204ef0602977 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:28.927530 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d777ecf8-6404-4396-8127-d8ef8cad0487 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:28.928045 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d777ecf8-6404-4396-8127-d8ef8cad0487 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:28.928911 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d777ecf8-6404-4396-8127-d8ef8cad0487 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:28.929802 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d777ecf8-6404-4396-8127-d8ef8cad0487 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:28.934386 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-60fb9a33-afb8-4aa8-8414-204ef0602977 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:28.934995 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-60fb9a33-afb8-4aa8-8414-204ef0602977 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:28.935849 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-60fb9a33-afb8-4aa8-8414-204ef0602977 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:28.936293 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-60fb9a33-afb8-4aa8-8414-204ef0602977 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:28.966586 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-60fb9a33-afb8-4aa8-8414-204ef0602977 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048145 Aug 27 01:34:28.968551 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 406/765] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:34:28 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:34:29.057231 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-d777ecf8-6404-4396-8127-d8ef8cad0487 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:29.064758 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-d777ecf8-6404-4396-8127-d8ef8cad0487 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1676 microversion: 2.1 time: 0.149065 Aug 27 01:34:29.065380 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 360/766] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:28 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:29.116851 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-7e0930a5-9a47-4d84-968d-5a0d5e407d4e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:29.117461 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-7e0930a5-9a47-4d84-968d-5a0d5e407d4e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 6e8afedf-7eb5-446f-a22d-1412c3a11039] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:29.123885 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7e0930a5-9a47-4d84-968d-5a0d5e407d4e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:29.124323 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7e0930a5-9a47-4d84-968d-5a0d5e407d4e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:29.125102 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7e0930a5-9a47-4d84-968d-5a0d5e407d4e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:29.125656 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7e0930a5-9a47-4d84-968d-5a0d5e407d4e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:29.156054 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7e0930a5-9a47-4d84-968d-5a0d5e407d4e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:29.156498 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7e0930a5-9a47-4d84-968d-5a0d5e407d4e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:29.156961 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.objects.instance [None req-7e0930a5-9a47-4d84-968d-5a0d5e407d4e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lazy-loading 'fault' on Instance uuid 6e8afedf-7eb5-446f-a22d-1412c3a11039 {{(pid=108755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:34:29.208773 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-7e0930a5-9a47-4d84-968d-5a0d5e407d4e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:29.216270 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-7e0930a5-9a47-4d84-968d-5a0d5e407d4e tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039" status: 200 len: 1308 microversion: 2.1 time: 0.103208 Aug 27 01:34:29.216866 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 407/767] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:29 2021] GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039 => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:29.238839 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-1923b66e-e6ea-47ea-a36e-329dc697e9dd tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:29.239447 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-1923b66e-e6ea-47ea-a36e-329dc697e9dd tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 3c494433-2508-45e2-8373-13c34a7c565e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:29.246227 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1923b66e-e6ea-47ea-a36e-329dc697e9dd tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:29.246680 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1923b66e-e6ea-47ea-a36e-329dc697e9dd tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:29.247449 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1923b66e-e6ea-47ea-a36e-329dc697e9dd tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:29.247888 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1923b66e-e6ea-47ea-a36e-329dc697e9dd tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:29.371708 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-1923b66e-e6ea-47ea-a36e-329dc697e9dd tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:29.378929 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-1923b66e-e6ea-47ea-a36e-329dc697e9dd tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e" status: 200 len: 1319 microversion: 2.1 time: 0.143757 Aug 27 01:34:29.379518 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 361/768] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:29 2021] GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:29.979116 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-3cee3cfe-76a2-4a93-9b4a-da6bf92e138d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:29.980025 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-3cee3cfe-76a2-4a93-9b4a-da6bf92e138d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:29.985891 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3cee3cfe-76a2-4a93-9b4a-da6bf92e138d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:29.986344 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3cee3cfe-76a2-4a93-9b4a-da6bf92e138d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:29.987138 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3cee3cfe-76a2-4a93-9b4a-da6bf92e138d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:29.987570 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3cee3cfe-76a2-4a93-9b4a-da6bf92e138d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:30.016561 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-3cee3cfe-76a2-4a93-9b4a-da6bf92e138d tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041734 Aug 27 01:34:30.017354 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 408/769] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:34:29 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:34:30.082238 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-e2174acd-773b-4fb0-932a-f3b9a2be8a15 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:30.082846 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-e2174acd-773b-4fb0-932a-f3b9a2be8a15 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:30.089512 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e2174acd-773b-4fb0-932a-f3b9a2be8a15 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:30.089962 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e2174acd-773b-4fb0-932a-f3b9a2be8a15 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:30.090735 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e2174acd-773b-4fb0-932a-f3b9a2be8a15 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:30.091175 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e2174acd-773b-4fb0-932a-f3b9a2be8a15 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:30.213919 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-e2174acd-773b-4fb0-932a-f3b9a2be8a15 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:30.221329 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-e2174acd-773b-4fb0-932a-f3b9a2be8a15 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1676 microversion: 2.1 time: 0.142679 Aug 27 01:34:30.221898 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 362/770] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:30 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1676 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:30.233291 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-8bca9ec5-6ad1-4ace-83cf-f957e7beb285 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:30.233971 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-8bca9ec5-6ad1-4ace-83cf-f957e7beb285 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: 6e8afedf-7eb5-446f-a22d-1412c3a11039] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:30.239736 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8bca9ec5-6ad1-4ace-83cf-f957e7beb285 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:30.240173 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8bca9ec5-6ad1-4ace-83cf-f957e7beb285 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:30.240953 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8bca9ec5-6ad1-4ace-83cf-f957e7beb285 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:30.241378 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8bca9ec5-6ad1-4ace-83cf-f957e7beb285 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:30.255171 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.wsgi [None req-8bca9ec5-6ad1-4ace-83cf-f957e7beb285 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] HTTP exception thrown: Instance 6e8afedf-7eb5-446f-a22d-1412c3a11039 could not be found. Aug 27 01:34:30.255772 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-8bca9ec5-6ad1-4ace-83cf-f957e7beb285 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Returning 404 to user: Instance 6e8afedf-7eb5-446f-a22d-1412c3a11039 could not be found. {{(pid=108755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:34:30.256567 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-8bca9ec5-6ad1-4ace-83cf-f957e7beb285 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039" status: 404 len: 111 microversion: 2.1 time: 0.028304 Aug 27 01:34:30.257105 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 409/771] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:30 2021] GET /compute/v2.1/servers/6e8afedf-7eb5-446f-a22d-1412c3a11039 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:34:30.394569 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-5204dc93-3a84-435b-9cc1-47f1c4edc9f4 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:30.395220 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-5204dc93-3a84-435b-9cc1-47f1c4edc9f4 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 3c494433-2508-45e2-8373-13c34a7c565e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:30.401586 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5204dc93-3a84-435b-9cc1-47f1c4edc9f4 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:30.402030 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5204dc93-3a84-435b-9cc1-47f1c4edc9f4 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:30.402801 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5204dc93-3a84-435b-9cc1-47f1c4edc9f4 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:30.403369 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5204dc93-3a84-435b-9cc1-47f1c4edc9f4 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:30.530620 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-5204dc93-3a84-435b-9cc1-47f1c4edc9f4 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:30.537850 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-5204dc93-3a84-435b-9cc1-47f1c4edc9f4 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e" status: 200 len: 1319 microversion: 2.1 time: 0.147096 Aug 27 01:34:30.541557 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 363/772] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:30 2021] GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:31.027990 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-c3985342-65ca-4caf-88de-3ed373e83803 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:31.028913 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-c3985342-65ca-4caf-88de-3ed373e83803 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:31.034529 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c3985342-65ca-4caf-88de-3ed373e83803 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:31.034972 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c3985342-65ca-4caf-88de-3ed373e83803 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:31.035717 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c3985342-65ca-4caf-88de-3ed373e83803 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:31.036147 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c3985342-65ca-4caf-88de-3ed373e83803 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:31.065287 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-c3985342-65ca-4caf-88de-3ed373e83803 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041606 Aug 27 01:34:31.065827 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 410/773] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:34:31 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 01:34:31.238753 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-85323359-ef7b-4130-b381-725aebf5d11f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:31.239353 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-85323359-ef7b-4130-b381-725aebf5d11f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:31.245647 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-85323359-ef7b-4130-b381-725aebf5d11f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:31.246090 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-85323359-ef7b-4130-b381-725aebf5d11f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:31.246852 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-85323359-ef7b-4130-b381-725aebf5d11f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:31.247283 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-85323359-ef7b-4130-b381-725aebf5d11f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:31.372761 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-85323359-ef7b-4130-b381-725aebf5d11f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:31.380063 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-85323359-ef7b-4130-b381-725aebf5d11f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1676 microversion: 2.1 time: 0.144970 Aug 27 01:34:31.380618 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 364/774] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:31 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1676 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:31.522331 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-9ac876d1-7ac8-4987-b969-87932e4876e9 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:31.522814 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-9ac876d1-7ac8-4987-b969-87932e4876e9 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:31.529118 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9ac876d1-7ac8-4987-b969-87932e4876e9 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:31.529558 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9ac876d1-7ac8-4987-b969-87932e4876e9 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:31.530311 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9ac876d1-7ac8-4987-b969-87932e4876e9 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:31.530747 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9ac876d1-7ac8-4987-b969-87932e4876e9 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:31.554461 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c18f7742-1d52-47f1-99e1-16eaf7ef8a54 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:31.555080 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-9ac876d1-7ac8-4987-b969-87932e4876e9 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Going to try to terminate instance {{(pid=108755) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 01:34:31.555213 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c18f7742-1d52-47f1-99e1-16eaf7ef8a54 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 3c494433-2508-45e2-8373-13c34a7c565e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:31.561519 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c18f7742-1d52-47f1-99e1-16eaf7ef8a54 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:31.561921 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c18f7742-1d52-47f1-99e1-16eaf7ef8a54 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:31.562689 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c18f7742-1d52-47f1-99e1-16eaf7ef8a54 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:31.563124 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c18f7742-1d52-47f1-99e1-16eaf7ef8a54 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:31.681194 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c18f7742-1d52-47f1-99e1-16eaf7ef8a54 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:31.689113 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c18f7742-1d52-47f1-99e1-16eaf7ef8a54 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e" status: 200 len: 1319 microversion: 2.1 time: 0.138213 Aug 27 01:34:31.689670 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 365/775] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:31 2021] GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e => generated 1319 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:34:31.991981 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-9ac876d1-7ac8-4987-b969-87932e4876e9 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 204 len: 0 microversion: 2.1 time: 0.472948 Aug 27 01:34:31.992664 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 411/776] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Aug 27 01:34:31 2021] DELETE /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 01:34:32.000444 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-fb00f2a6-3119-4e5f-8e57-56a9a5b55636 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:32.001243 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-fb00f2a6-3119-4e5f-8e57-56a9a5b55636 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:32.007000 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fb00f2a6-3119-4e5f-8e57-56a9a5b55636 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:32.007449 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fb00f2a6-3119-4e5f-8e57-56a9a5b55636 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:32.008214 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fb00f2a6-3119-4e5f-8e57-56a9a5b55636 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:32.008643 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fb00f2a6-3119-4e5f-8e57-56a9a5b55636 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:32.060479 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-28d6f531-6df5-4a75-b3f2-7ee03991644c req-dc2d7462-a313-4fd1-ab65-fc7ddf3b4e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c494433-2508-45e2-8373-13c34a7c565e", "name": "network-vif-plugged", "status": "completed", "tag": "2c66452a-5d7b-476f-b9bc-f96d7b0ab669"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:34:32.062162 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:34:32.062162 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:34:32.069872 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-28d6f531-6df5-4a75-b3f2-7ee03991644c req-dc2d7462-a313-4fd1-ab65-fc7ddf3b4e07 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:32.070631 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-28d6f531-6df5-4a75-b3f2-7ee03991644c req-dc2d7462-a313-4fd1-ab65-fc7ddf3b4e07 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:32.082094 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-28d6f531-6df5-4a75-b3f2-7ee03991644c req-dc2d7462-a313-4fd1-ab65-fc7ddf3b4e07 service nova] Creating event network-vif-plugged:2c66452a-5d7b-476f-b9bc-f96d7b0ab669 for instance 3c494433-2508-45e2-8373-13c34a7c565e on hv-cinder-75916 Aug 27 01:34:32.087243 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-28d6f531-6df5-4a75-b3f2-7ee03991644c req-dc2d7462-a313-4fd1-ab65-fc7ddf3b4e07 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030704 Aug 27 01:34:32.088350 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 412/777] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:34:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:34:32.132184 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-fb00f2a6-3119-4e5f-8e57-56a9a5b55636 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:32.140023 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-fb00f2a6-3119-4e5f-8e57-56a9a5b55636 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1514 microversion: 2.1 time: 0.143185 Aug 27 01:34:32.140870 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 366/778] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:31 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1514 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:32.397676 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-c3d471d0-6097-430f-8369-ff3003e7deaa tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:32.398368 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-c3d471d0-6097-430f-8369-ff3003e7deaa tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:32.405943 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c3d471d0-6097-430f-8369-ff3003e7deaa tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:32.406385 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c3d471d0-6097-430f-8369-ff3003e7deaa tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:32.407220 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c3d471d0-6097-430f-8369-ff3003e7deaa tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:32.407578 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c3d471d0-6097-430f-8369-ff3003e7deaa tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:32.551447 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-c3d471d0-6097-430f-8369-ff3003e7deaa tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:32.558687 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-c3d471d0-6097-430f-8369-ff3003e7deaa tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1676 microversion: 2.1 time: 0.164948 Aug 27 01:34:32.559241 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 413/779] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:32 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:32.704752 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-6d5763d2-bb5c-4ce7-a23c-71c2aa27906c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:32.705311 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-6d5763d2-bb5c-4ce7-a23c-71c2aa27906c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 3c494433-2508-45e2-8373-13c34a7c565e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:32.710977 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6d5763d2-bb5c-4ce7-a23c-71c2aa27906c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:32.711421 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6d5763d2-bb5c-4ce7-a23c-71c2aa27906c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:32.712185 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6d5763d2-bb5c-4ce7-a23c-71c2aa27906c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:32.712633 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6d5763d2-bb5c-4ce7-a23c-71c2aa27906c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:32.833296 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-6d5763d2-bb5c-4ce7-a23c-71c2aa27906c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:32.841722 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-6d5763d2-bb5c-4ce7-a23c-71c2aa27906c tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e" status: 200 len: 1319 microversion: 2.1 time: 0.140612 Aug 27 01:34:32.842322 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 367/780] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:32 2021] GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e => generated 1319 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:33.157431 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-313c4a69-67f5-48dc-86d2-286492ecad01 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:33.163816 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-313c4a69-67f5-48dc-86d2-286492ecad01 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:33.164395 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-313c4a69-67f5-48dc-86d2-286492ecad01 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:33.164924 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-313c4a69-67f5-48dc-86d2-286492ecad01 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:33.166330 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-313c4a69-67f5-48dc-86d2-286492ecad01 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:33.166862 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-313c4a69-67f5-48dc-86d2-286492ecad01 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:33.296088 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-313c4a69-67f5-48dc-86d2-286492ecad01 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:33.304089 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-313c4a69-67f5-48dc-86d2-286492ecad01 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1514 microversion: 2.1 time: 0.150398 Aug 27 01:34:33.304643 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 414/781] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:33 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:33.575225 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-f86b6b37-15c5-4685-bec0-d6fa5b304760 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:33.575849 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-f86b6b37-15c5-4685-bec0-d6fa5b304760 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:33.581704 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f86b6b37-15c5-4685-bec0-d6fa5b304760 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:33.582147 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f86b6b37-15c5-4685-bec0-d6fa5b304760 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:33.582907 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f86b6b37-15c5-4685-bec0-d6fa5b304760 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:33.583339 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f86b6b37-15c5-4685-bec0-d6fa5b304760 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:33.652082 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-ceb37921-c6a4-4d29-98ae-63a5d03cd0f7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:33.652782 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-ceb37921-c6a4-4d29-98ae-63a5d03cd0f7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:33.659498 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ceb37921-c6a4-4d29-98ae-63a5d03cd0f7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:33.659952 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ceb37921-c6a4-4d29-98ae-63a5d03cd0f7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:33.660730 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ceb37921-c6a4-4d29-98ae-63a5d03cd0f7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:33.661227 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ceb37921-c6a4-4d29-98ae-63a5d03cd0f7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:33.688523 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-ceb37921-c6a4-4d29-98ae-63a5d03cd0f7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Going to try to terminate instance {{(pid=108755) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 01:34:33.706777 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-f86b6b37-15c5-4685-bec0-d6fa5b304760 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:33.714874 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-f86b6b37-15c5-4685-bec0-d6fa5b304760 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1676 microversion: 2.1 time: 0.143245 Aug 27 01:34:33.724112 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 368/782] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:33 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:33.858273 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-b117be57-3829-4ab3-bf9e-2059c1b7a69e tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:33.858887 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-b117be57-3829-4ab3-bf9e-2059c1b7a69e tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 3c494433-2508-45e2-8373-13c34a7c565e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:33.865202 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b117be57-3829-4ab3-bf9e-2059c1b7a69e tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:33.865663 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b117be57-3829-4ab3-bf9e-2059c1b7a69e tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:33.866539 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b117be57-3829-4ab3-bf9e-2059c1b7a69e tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:33.866975 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b117be57-3829-4ab3-bf9e-2059c1b7a69e tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:33.992446 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-ceb37921-c6a4-4d29-98ae-63a5d03cd0f7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 204 len: 0 microversion: 2.1 time: 0.344006 Aug 27 01:34:33.994218 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 415/783] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Aug 27 01:34:33 2021] DELETE /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 01:34:33.997190 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-b117be57-3829-4ab3-bf9e-2059c1b7a69e tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:34.004856 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-e88b7423-6dd7-4620-b711-4006c5a59a12 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:34.005553 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-e88b7423-6dd7-4620-b711-4006c5a59a12 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:34.018658 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-b117be57-3829-4ab3-bf9e-2059c1b7a69e tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e" status: 200 len: 1319 microversion: 2.1 time: 0.163940 Aug 27 01:34:34.020327 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e88b7423-6dd7-4620-b711-4006c5a59a12 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:34.020768 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e88b7423-6dd7-4620-b711-4006c5a59a12 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:34.021578 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e88b7423-6dd7-4620-b711-4006c5a59a12 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:34.022011 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e88b7423-6dd7-4620-b711-4006c5a59a12 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:34.035511 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 369/784] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:33 2021] GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:34.145247 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-e88b7423-6dd7-4620-b711-4006c5a59a12 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:34.153129 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-e88b7423-6dd7-4620-b711-4006c5a59a12 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1508 microversion: 2.1 time: 0.153403 Aug 27 01:34:34.153677 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 416/785] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:33 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:34.321527 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-8891a39f-fdd5-411a-b3f0-b6d0254600f5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:34.322127 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-8891a39f-fdd5-411a-b3f0-b6d0254600f5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:34.327940 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8891a39f-fdd5-411a-b3f0-b6d0254600f5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:34.328377 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8891a39f-fdd5-411a-b3f0-b6d0254600f5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:34.329183 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8891a39f-fdd5-411a-b3f0-b6d0254600f5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:34.329595 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8891a39f-fdd5-411a-b3f0-b6d0254600f5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:34.454047 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-8891a39f-fdd5-411a-b3f0-b6d0254600f5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:34.461332 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-8891a39f-fdd5-411a-b3f0-b6d0254600f5 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1514 microversion: 2.1 time: 0.143532 Aug 27 01:34:34.461897 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 370/786] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:34 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1514 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:34.731767 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4b29ccb9-9d51-49d2-b2bc-2db48cb483da tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:34.732376 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4b29ccb9-9d51-49d2-b2bc-2db48cb483da tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:34.738177 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4b29ccb9-9d51-49d2-b2bc-2db48cb483da tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:34.738623 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4b29ccb9-9d51-49d2-b2bc-2db48cb483da tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:34.739385 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4b29ccb9-9d51-49d2-b2bc-2db48cb483da tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:34.739825 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4b29ccb9-9d51-49d2-b2bc-2db48cb483da tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:34.926543 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4b29ccb9-9d51-49d2-b2bc-2db48cb483da tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:34.934136 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4b29ccb9-9d51-49d2-b2bc-2db48cb483da tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1676 microversion: 2.1 time: 0.206507 Aug 27 01:34:34.935154 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 417/787] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:34 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1676 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:35.043553 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-aab7ea06-d5f3-4416-9de4-2801457a01c9 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:35.044140 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-aab7ea06-d5f3-4416-9de4-2801457a01c9 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 3c494433-2508-45e2-8373-13c34a7c565e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:35.050656 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-aab7ea06-d5f3-4416-9de4-2801457a01c9 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:35.051097 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-aab7ea06-d5f3-4416-9de4-2801457a01c9 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:35.051878 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-aab7ea06-d5f3-4416-9de4-2801457a01c9 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:35.052309 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-aab7ea06-d5f3-4416-9de4-2801457a01c9 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:35.171251 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-24db9cb1-72ef-4933-ad11-242fb284c17b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:35.171466 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-24db9cb1-72ef-4933-ad11-242fb284c17b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:35.177466 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-24db9cb1-72ef-4933-ad11-242fb284c17b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:35.178010 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-24db9cb1-72ef-4933-ad11-242fb284c17b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:35.178690 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-24db9cb1-72ef-4933-ad11-242fb284c17b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:35.179123 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-24db9cb1-72ef-4933-ad11-242fb284c17b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:35.180816 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-aab7ea06-d5f3-4416-9de4-2801457a01c9 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:35.190771 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-aab7ea06-d5f3-4416-9de4-2801457a01c9 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e" status: 200 len: 1508 microversion: 2.1 time: 0.151408 Aug 27 01:34:35.191595 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 371/788] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:35 2021] GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:35.210323 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-f9dd54ef-68a8-4684-a0fd-4ee9be05ef54 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "949150e2-2722-49e5-b898-a981cbd47f64", "device": "/dev/sdb"}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:34:35.211511 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-f9dd54ef-68a8-4684-a0fd-4ee9be05ef54 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 3c494433-2508-45e2-8373-13c34a7c565e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:35.218660 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f9dd54ef-68a8-4684-a0fd-4ee9be05ef54 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:35.219111 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f9dd54ef-68a8-4684-a0fd-4ee9be05ef54 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:35.219942 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f9dd54ef-68a8-4684-a0fd-4ee9be05ef54 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:35.220369 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f9dd54ef-68a8-4684-a0fd-4ee9be05ef54 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:35.401571 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-24db9cb1-72ef-4933-ad11-242fb284c17b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:35.409190 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-24db9cb1-72ef-4933-ad11-242fb284c17b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1508 microversion: 2.1 time: 0.242229 Aug 27 01:34:35.409754 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 418/789] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:35 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1508 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:34:35.479032 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-8b60f030-72ec-4662-80a0-c9d380aca900 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:35.479554 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-8b60f030-72ec-4662-80a0-c9d380aca900 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:35.485443 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8b60f030-72ec-4662-80a0-c9d380aca900 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:35.485892 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8b60f030-72ec-4662-80a0-c9d380aca900 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:35.486652 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8b60f030-72ec-4662-80a0-c9d380aca900 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:35.487079 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8b60f030-72ec-4662-80a0-c9d380aca900 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:35.590340 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-8b60f030-72ec-4662-80a0-c9d380aca900 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:35.594771 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-8b60f030-72ec-4662-80a0-c9d380aca900 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1472 microversion: 2.1 time: 0.119895 Aug 27 01:34:35.595337 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 419/790] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:35 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1472 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:34:35.599604 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-a0d59cd5-b53a-4561-bb46-0f66f208bd63 req-550638db-db9e-4b1e-8792-9e69edbb8797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f70206d1-bfb4-4b0a-9215-72f8e06a7c66", "name": "network-vif-deleted", "tag": "c1d36e2a-bbeb-40d1-84c2-dacc81e5fe3e"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:34:35.601201 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:34:35.601201 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:34:35.616334 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-a0d59cd5-b53a-4561-bb46-0f66f208bd63 req-550638db-db9e-4b1e-8792-9e69edbb8797 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:35.620016 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-a0d59cd5-b53a-4561-bb46-0f66f208bd63 req-550638db-db9e-4b1e-8792-9e69edbb8797 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:35.628091 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-a0d59cd5-b53a-4561-bb46-0f66f208bd63 req-550638db-db9e-4b1e-8792-9e69edbb8797 service nova] Creating event network-vif-deleted:c1d36e2a-bbeb-40d1-84c2-dacc81e5fe3e for instance f70206d1-bfb4-4b0a-9215-72f8e06a7c66 on hv-cinder-75916 Aug 27 01:34:35.632822 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-a0d59cd5-b53a-4561-bb46-0f66f208bd63 req-550638db-db9e-4b1e-8792-9e69edbb8797 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036390 Aug 27 01:34:35.633606 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 420/791] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:34:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:34:35.952793 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-290f0faa-c173-4224-b6e5-faeeeec1242c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:35.953666 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-290f0faa-c173-4224-b6e5-faeeeec1242c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:35.961014 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-290f0faa-c173-4224-b6e5-faeeeec1242c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:35.961595 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-290f0faa-c173-4224-b6e5-faeeeec1242c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:35.962427 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-290f0faa-c173-4224-b6e5-faeeeec1242c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:35.962878 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-290f0faa-c173-4224-b6e5-faeeeec1242c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:36.086394 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-290f0faa-c173-4224-b6e5-faeeeec1242c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:36.093574 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-290f0faa-c173-4224-b6e5-faeeeec1242c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1676 microversion: 2.1 time: 0.146187 Aug 27 01:34:36.094125 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 421/792] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:35 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:36.312930 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-f9dd54ef-68a8-4684-a0fd-4ee9be05ef54 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "POST /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.104492 Aug 27 01:34:36.314295 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 372/793] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Aug 27 01:34:35 2021] POST /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e/os-volume_attachments => generated 194 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:34:36.427760 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-46d1ab90-d7ea-44ac-b961-18865d02286b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:36.428366 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-46d1ab90-d7ea-44ac-b961-18865d02286b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:36.434755 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-46d1ab90-d7ea-44ac-b961-18865d02286b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:36.435205 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-46d1ab90-d7ea-44ac-b961-18865d02286b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:36.436026 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-46d1ab90-d7ea-44ac-b961-18865d02286b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:36.436459 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-46d1ab90-d7ea-44ac-b961-18865d02286b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:36.558959 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-46d1ab90-d7ea-44ac-b961-18865d02286b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:36.566259 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-46d1ab90-d7ea-44ac-b961-18865d02286b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1508 microversion: 2.1 time: 0.142541 Aug 27 01:34:36.566758 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 422/794] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:36 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1508 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:36.613858 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-3d5e8c46-faae-4702-8e13-bf3a012c3967 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:36.614555 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-3d5e8c46-faae-4702-8e13-bf3a012c3967 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:36.621017 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3d5e8c46-faae-4702-8e13-bf3a012c3967 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:36.621467 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3d5e8c46-faae-4702-8e13-bf3a012c3967 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:36.622241 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3d5e8c46-faae-4702-8e13-bf3a012c3967 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:36.622675 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3d5e8c46-faae-4702-8e13-bf3a012c3967 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:36.654629 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3d5e8c46-faae-4702-8e13-bf3a012c3967 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:36.655068 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3d5e8c46-faae-4702-8e13-bf3a012c3967 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:36.655533 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.objects.instance [None req-3d5e8c46-faae-4702-8e13-bf3a012c3967 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lazy-loading 'fault' on Instance uuid f70206d1-bfb4-4b0a-9215-72f8e06a7c66 {{(pid=108756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:34:36.695113 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-3d5e8c46-faae-4702-8e13-bf3a012c3967 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589eca6a184e4505a0c0f97efe65892e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9439f7236d4228aea4ccc73e5d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:36.702313 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-3d5e8c46-faae-4702-8e13-bf3a012c3967 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 200 len: 1308 microversion: 2.1 time: 0.092834 Aug 27 01:34:36.702870 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 373/795] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:36 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:37.109351 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b66669ee-9aac-4016-a42e-7a23104bd99d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:37.109950 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b66669ee-9aac-4016-a42e-7a23104bd99d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:37.115731 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b66669ee-9aac-4016-a42e-7a23104bd99d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:37.116172 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b66669ee-9aac-4016-a42e-7a23104bd99d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:37.116951 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b66669ee-9aac-4016-a42e-7a23104bd99d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:37.117379 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b66669ee-9aac-4016-a42e-7a23104bd99d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:37.243652 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-b66669ee-9aac-4016-a42e-7a23104bd99d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:37.252026 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b66669ee-9aac-4016-a42e-7a23104bd99d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1676 microversion: 2.1 time: 0.146320 Aug 27 01:34:37.252690 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 423/796] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:37 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:37.582735 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-fa619d0d-3f27-43d1-a7dd-e6b5168af8aa tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:37.583407 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-fa619d0d-3f27-43d1-a7dd-e6b5168af8aa tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:37.589436 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fa619d0d-3f27-43d1-a7dd-e6b5168af8aa tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:37.590062 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fa619d0d-3f27-43d1-a7dd-e6b5168af8aa tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:37.590987 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fa619d0d-3f27-43d1-a7dd-e6b5168af8aa tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:37.591428 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fa619d0d-3f27-43d1-a7dd-e6b5168af8aa tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:37.721503 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-8d5581b2-7af1-4bd8-bbd5-4a10e6df37b1 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:37.722302 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-8d5581b2-7af1-4bd8-bbd5-4a10e6df37b1 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] [instance: f70206d1-bfb4-4b0a-9215-72f8e06a7c66] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:37.724688 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-fa619d0d-3f27-43d1-a7dd-e6b5168af8aa tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:37.728029 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8d5581b2-7af1-4bd8-bbd5-4a10e6df37b1 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:37.728586 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8d5581b2-7af1-4bd8-bbd5-4a10e6df37b1 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:37.729724 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8d5581b2-7af1-4bd8-bbd5-4a10e6df37b1 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:37.730382 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8d5581b2-7af1-4bd8-bbd5-4a10e6df37b1 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:37.732655 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-fa619d0d-3f27-43d1-a7dd-e6b5168af8aa tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1508 microversion: 2.1 time: 0.153489 Aug 27 01:34:37.733250 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 374/797] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:37 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:37.744792 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.wsgi [None req-8d5581b2-7af1-4bd8-bbd5-4a10e6df37b1 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] HTTP exception thrown: Instance f70206d1-bfb4-4b0a-9215-72f8e06a7c66 could not be found. Aug 27 01:34:37.745574 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-8d5581b2-7af1-4bd8-bbd5-4a10e6df37b1 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] Returning 404 to user: Instance f70206d1-bfb4-4b0a-9215-72f8e06a7c66 could not be found. {{(pid=108755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:34:37.746472 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-8d5581b2-7af1-4bd8-bbd5-4a10e6df37b1 tempest-AttachVolumeNegativeTest-1016920834 tempest-AttachVolumeNegativeTest-1016920834-project] 10.222.0.25 "GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66" status: 404 len: 111 microversion: 2.1 time: 0.030456 Aug 27 01:34:37.747105 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 424/798] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:37 2021] GET /compute/v2.1/servers/f70206d1-bfb4-4b0a-9215-72f8e06a7c66 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:34:37.968239 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-f9c94beb-2912-4c9b-83c8-c886f11b51de req-6d8fd237-6284-4a55-988c-626607951b35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a469663-cc2c-4a11-8486-a758a0682e39", "name": "network-vif-deleted", "tag": "f0fa47c1-eb17-4a46-982a-113bf408fe87"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:34:37.970021 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:34:37.970021 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:34:37.976922 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-f9c94beb-2912-4c9b-83c8-c886f11b51de req-6d8fd237-6284-4a55-988c-626607951b35 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:37.977312 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-f9c94beb-2912-4c9b-83c8-c886f11b51de req-6d8fd237-6284-4a55-988c-626607951b35 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:37.988645 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-f9c94beb-2912-4c9b-83c8-c886f11b51de req-6d8fd237-6284-4a55-988c-626607951b35 service nova] Creating event network-vif-deleted:f0fa47c1-eb17-4a46-982a-113bf408fe87 for instance 5a469663-cc2c-4a11-8486-a758a0682e39 on hv-cinder-75916 Aug 27 01:34:37.993462 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-f9c94beb-2912-4c9b-83c8-c886f11b51de req-6d8fd237-6284-4a55-988c-626607951b35 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028996 Aug 27 01:34:37.994110 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 375/799] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:34:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:34:38.273547 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b975b783-052a-48b5-9cba-f814303c74dc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:38.274848 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b975b783-052a-48b5-9cba-f814303c74dc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:38.283835 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b975b783-052a-48b5-9cba-f814303c74dc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:38.283835 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b975b783-052a-48b5-9cba-f814303c74dc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:38.283835 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b975b783-052a-48b5-9cba-f814303c74dc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:38.283835 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b975b783-052a-48b5-9cba-f814303c74dc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:38.422274 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-b975b783-052a-48b5-9cba-f814303c74dc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:38.430229 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b975b783-052a-48b5-9cba-f814303c74dc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1676 microversion: 2.1 time: 0.163943 Aug 27 01:34:38.430787 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 425/800] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:38 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:38.751110 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c3ddac39-cc2a-4dde-81c0-7bcb6e0e7966 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:38.751779 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c3ddac39-cc2a-4dde-81c0-7bcb6e0e7966 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:38.757706 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c3ddac39-cc2a-4dde-81c0-7bcb6e0e7966 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:38.761714 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c3ddac39-cc2a-4dde-81c0-7bcb6e0e7966 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:38.761714 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c3ddac39-cc2a-4dde-81c0-7bcb6e0e7966 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:38.761714 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c3ddac39-cc2a-4dde-81c0-7bcb6e0e7966 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:38.790533 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c3ddac39-cc2a-4dde-81c0-7bcb6e0e7966 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:38.790982 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c3ddac39-cc2a-4dde-81c0-7bcb6e0e7966 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:38.791429 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.objects.instance [None req-c3ddac39-cc2a-4dde-81c0-7bcb6e0e7966 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lazy-loading 'fault' on Instance uuid 5a469663-cc2c-4a11-8486-a758a0682e39 {{(pid=108756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:34:38.851778 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c3ddac39-cc2a-4dde-81c0-7bcb6e0e7966 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:38.859916 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c3ddac39-cc2a-4dde-81c0-7bcb6e0e7966 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 200 len: 1312 microversion: 2.1 time: 0.113249 Aug 27 01:34:38.860686 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 376/801] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:38 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 1312 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:39.447137 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-8d66567c-6862-4c6c-9b16-0d8eab0fb080 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:39.447746 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-8d66567c-6862-4c6c-9b16-0d8eab0fb080 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:39.453785 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8d66567c-6862-4c6c-9b16-0d8eab0fb080 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:39.455382 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8d66567c-6862-4c6c-9b16-0d8eab0fb080 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:39.455382 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8d66567c-6862-4c6c-9b16-0d8eab0fb080 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:39.455382 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8d66567c-6862-4c6c-9b16-0d8eab0fb080 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:39.590207 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-8d66567c-6862-4c6c-9b16-0d8eab0fb080 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:39.597080 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-8d66567c-6862-4c6c-9b16-0d8eab0fb080 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1676 microversion: 2.1 time: 0.153483 Aug 27 01:34:39.597649 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 426/802] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:39 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:39.876414 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ed6a0c93-9c0b-47b7-b4ca-e0f3273b18d4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:39.877062 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-ed6a0c93-9c0b-47b7-b4ca-e0f3273b18d4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 5a469663-cc2c-4a11-8486-a758a0682e39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:39.882872 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ed6a0c93-9c0b-47b7-b4ca-e0f3273b18d4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:39.883325 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ed6a0c93-9c0b-47b7-b4ca-e0f3273b18d4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:39.884095 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ed6a0c93-9c0b-47b7-b4ca-e0f3273b18d4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:39.884536 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ed6a0c93-9c0b-47b7-b4ca-e0f3273b18d4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:39.905737 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.wsgi [None req-ed6a0c93-9c0b-47b7-b4ca-e0f3273b18d4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] HTTP exception thrown: Instance 5a469663-cc2c-4a11-8486-a758a0682e39 could not be found. Aug 27 01:34:39.905737 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ed6a0c93-9c0b-47b7-b4ca-e0f3273b18d4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Returning 404 to user: Instance 5a469663-cc2c-4a11-8486-a758a0682e39 could not be found. {{(pid=108756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:34:39.905737 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-ed6a0c93-9c0b-47b7-b4ca-e0f3273b18d4 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39" status: 404 len: 111 microversion: 2.1 time: 0.027003 Aug 27 01:34:39.905737 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 377/803] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:39 2021] GET /compute/v2.1/servers/5a469663-cc2c-4a11-8486-a758a0682e39 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:34:39.912312 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-19e67061-9731-4130-9a41-8b35d18cb7ec tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:39.912888 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-19e67061-9731-4130-9a41-8b35d18cb7ec tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:39.919578 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-19e67061-9731-4130-9a41-8b35d18cb7ec tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:39.920033 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-19e67061-9731-4130-9a41-8b35d18cb7ec tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:39.920806 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-19e67061-9731-4130-9a41-8b35d18cb7ec tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:39.921278 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-19e67061-9731-4130-9a41-8b35d18cb7ec tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:39.946427 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-19e67061-9731-4130-9a41-8b35d18cb7ec tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Going to try to terminate instance {{(pid=108755) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 01:34:40.254639 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-19e67061-9731-4130-9a41-8b35d18cb7ec tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 204 len: 0 microversion: 2.1 time: 0.346005 Aug 27 01:34:40.255211 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 427/804] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Aug 27 01:34:39 2021] DELETE /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 01:34:40.263461 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ae5397e5-e82e-4032-8581-99ca316f7df7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:40.264070 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-ae5397e5-e82e-4032-8581-99ca316f7df7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:40.269772 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ae5397e5-e82e-4032-8581-99ca316f7df7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:40.283561 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ae5397e5-e82e-4032-8581-99ca316f7df7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:40.283561 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ae5397e5-e82e-4032-8581-99ca316f7df7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:40.283561 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ae5397e5-e82e-4032-8581-99ca316f7df7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:40.392883 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ae5397e5-e82e-4032-8581-99ca316f7df7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:40.400742 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-ae5397e5-e82e-4032-8581-99ca316f7df7 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.141386 Aug 27 01:34:40.401321 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 378/805] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:40 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:40.621793 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-bd1aece5-357f-4427-9ed2-25df0309cef8 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:40.621793 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-bd1aece5-357f-4427-9ed2-25df0309cef8 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:40.621793 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bd1aece5-357f-4427-9ed2-25df0309cef8 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:40.621793 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bd1aece5-357f-4427-9ed2-25df0309cef8 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:40.622516 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bd1aece5-357f-4427-9ed2-25df0309cef8 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:40.622840 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bd1aece5-357f-4427-9ed2-25df0309cef8 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:40.746376 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-bd1aece5-357f-4427-9ed2-25df0309cef8 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:40.754692 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-bd1aece5-357f-4427-9ed2-25df0309cef8 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1653 microversion: 2.1 time: 0.143451 Aug 27 01:34:40.754692 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 428/806] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:40 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1653 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:40.769564 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-46d4c5ae-db1e-4fca-8ced-987067f11d12 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:34:40.775313 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-46d4c5ae-db1e-4fca-8ced-987067f11d12 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:40.775756 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-46d4c5ae-db1e-4fca-8ced-987067f11d12 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:40.797860 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-46d4c5ae-db1e-4fca-8ced-987067f11d12 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Going to try to start instance {{(pid=108756) start /opt/stack/nova/nova/compute/api.py:2638}} Aug 27 01:34:40.984079 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-46d4c5ae-db1e-4fca-8ced-987067f11d12 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action" status: 202 len: 0 microversion: 2.1 time: 0.217961 Aug 27 01:34:40.984764 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 379/807] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:34:40 2021] POST /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:34:40.993862 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-c2503625-eed9-44f8-b213-8e4634825873 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:40.994475 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-c2503625-eed9-44f8-b213-8e4634825873 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:41.001164 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c2503625-eed9-44f8-b213-8e4634825873 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:41.001612 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c2503625-eed9-44f8-b213-8e4634825873 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:41.002662 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c2503625-eed9-44f8-b213-8e4634825873 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:41.003098 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c2503625-eed9-44f8-b213-8e4634825873 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:41.126879 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-c2503625-eed9-44f8-b213-8e4634825873 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:41.134295 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-c2503625-eed9-44f8-b213-8e4634825873 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1662 microversion: 2.1 time: 0.145430 Aug 27 01:34:41.134855 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 429/808] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:40 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1662 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:34:41.418330 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-5ac26cec-5e85-4faf-a6b5-ee5c11365242 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:41.419500 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-5ac26cec-5e85-4faf-a6b5-ee5c11365242 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:41.426177 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5ac26cec-5e85-4faf-a6b5-ee5c11365242 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:41.426703 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5ac26cec-5e85-4faf-a6b5-ee5c11365242 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:41.427669 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5ac26cec-5e85-4faf-a6b5-ee5c11365242 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:41.428167 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5ac26cec-5e85-4faf-a6b5-ee5c11365242 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:41.554183 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-5ac26cec-5e85-4faf-a6b5-ee5c11365242 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:41.562263 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-5ac26cec-5e85-4faf-a6b5-ee5c11365242 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.148827 Aug 27 01:34:41.562835 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 380/809] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:41 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:42.151575 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-5e790eb4-6d05-4eab-af40-a24ebfce4bfe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:42.152454 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-5e790eb4-6d05-4eab-af40-a24ebfce4bfe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:42.158717 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5e790eb4-6d05-4eab-af40-a24ebfce4bfe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:42.159152 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5e790eb4-6d05-4eab-af40-a24ebfce4bfe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:42.159916 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5e790eb4-6d05-4eab-af40-a24ebfce4bfe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:42.160628 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5e790eb4-6d05-4eab-af40-a24ebfce4bfe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:42.294778 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-5e790eb4-6d05-4eab-af40-a24ebfce4bfe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:42.302401 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-5e790eb4-6d05-4eab-af40-a24ebfce4bfe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1662 microversion: 2.1 time: 0.154507 Aug 27 01:34:42.303045 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 430/810] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:42 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1662 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:42.579222 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-7b54f524-4c1d-48d9-a49c-1043caf5bc68 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:42.579862 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-7b54f524-4c1d-48d9-a49c-1043caf5bc68 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:42.585555 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7b54f524-4c1d-48d9-a49c-1043caf5bc68 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:42.586001 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7b54f524-4c1d-48d9-a49c-1043caf5bc68 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:42.586760 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7b54f524-4c1d-48d9-a49c-1043caf5bc68 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:42.587190 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7b54f524-4c1d-48d9-a49c-1043caf5bc68 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:42.710822 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-7b54f524-4c1d-48d9-a49c-1043caf5bc68 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:42.718958 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-7b54f524-4c1d-48d9-a49c-1043caf5bc68 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.143431 Aug 27 01:34:42.723129 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 381/811] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:42 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:43.319156 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-9ce9f45f-659a-4f1c-9627-9d64a75fd855 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:43.319773 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-9ce9f45f-659a-4f1c-9627-9d64a75fd855 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:43.326731 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9ce9f45f-659a-4f1c-9627-9d64a75fd855 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:43.333528 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9ce9f45f-659a-4f1c-9627-9d64a75fd855 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:43.333528 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9ce9f45f-659a-4f1c-9627-9d64a75fd855 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:43.333528 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9ce9f45f-659a-4f1c-9627-9d64a75fd855 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:43.465031 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-9ce9f45f-659a-4f1c-9627-9d64a75fd855 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:43.472504 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-9ce9f45f-659a-4f1c-9627-9d64a75fd855 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1666 microversion: 2.1 time: 0.156983 Aug 27 01:34:43.473086 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 431/812] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:43 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1666 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:43.736507 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-5e90e88e-f2bc-4225-b80a-d9daa81a9678 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:43.737140 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-5e90e88e-f2bc-4225-b80a-d9daa81a9678 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:43.743420 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5e90e88e-f2bc-4225-b80a-d9daa81a9678 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:43.748290 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5e90e88e-f2bc-4225-b80a-d9daa81a9678 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:43.748290 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5e90e88e-f2bc-4225-b80a-d9daa81a9678 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:43.748290 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5e90e88e-f2bc-4225-b80a-d9daa81a9678 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:43.866129 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-5e90e88e-f2bc-4225-b80a-d9daa81a9678 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:43.873934 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-5e90e88e-f2bc-4225-b80a-d9daa81a9678 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.141019 Aug 27 01:34:43.874466 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 382/813] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:43 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:44.891233 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-fb50c6c5-cce6-44e7-a6a2-2a072a6525e0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:44.892128 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-fb50c6c5-cce6-44e7-a6a2-2a072a6525e0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:44.898480 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fb50c6c5-cce6-44e7-a6a2-2a072a6525e0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:44.899044 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fb50c6c5-cce6-44e7-a6a2-2a072a6525e0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:44.899934 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fb50c6c5-cce6-44e7-a6a2-2a072a6525e0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:44.900514 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fb50c6c5-cce6-44e7-a6a2-2a072a6525e0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:45.021410 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-fb50c6c5-cce6-44e7-a6a2-2a072a6525e0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:45.030500 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-fb50c6c5-cce6-44e7-a6a2-2a072a6525e0 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.141522 Aug 27 01:34:45.030500 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 432/814] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:44 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:46.046960 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-4cc28ab7-2999-4123-aed8-d84f86b28ccc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:46.047560 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-4cc28ab7-2999-4123-aed8-d84f86b28ccc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:46.054179 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4cc28ab7-2999-4123-aed8-d84f86b28ccc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:46.054653 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4cc28ab7-2999-4123-aed8-d84f86b28ccc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:46.055418 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4cc28ab7-2999-4123-aed8-d84f86b28ccc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:46.055844 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4cc28ab7-2999-4123-aed8-d84f86b28ccc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:46.178220 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-4cc28ab7-2999-4123-aed8-d84f86b28ccc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:46.185684 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-4cc28ab7-2999-4123-aed8-d84f86b28ccc tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.143576 Aug 27 01:34:46.186240 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 383/815] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:46 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:47.203110 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d5563000-b2dc-4a62-867a-e681b4dab58b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:47.203714 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d5563000-b2dc-4a62-867a-e681b4dab58b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:47.209559 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d5563000-b2dc-4a62-867a-e681b4dab58b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:47.210002 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d5563000-b2dc-4a62-867a-e681b4dab58b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:47.210769 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d5563000-b2dc-4a62-867a-e681b4dab58b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:47.211199 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d5563000-b2dc-4a62-867a-e681b4dab58b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:47.327183 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d5563000-b2dc-4a62-867a-e681b4dab58b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:47.334552 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d5563000-b2dc-4a62-867a-e681b4dab58b tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.135916 Aug 27 01:34:47.335337 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 433/816] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:47 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:48.351160 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c4d7be22-7101-4646-b257-87f6d740b470 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:48.351761 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c4d7be22-7101-4646-b257-87f6d740b470 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:48.357806 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c4d7be22-7101-4646-b257-87f6d740b470 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:48.358359 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c4d7be22-7101-4646-b257-87f6d740b470 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:48.359117 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c4d7be22-7101-4646-b257-87f6d740b470 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:48.359549 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c4d7be22-7101-4646-b257-87f6d740b470 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:48.477884 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c4d7be22-7101-4646-b257-87f6d740b470 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:48.485470 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c4d7be22-7101-4646-b257-87f6d740b470 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.137929 Aug 27 01:34:48.486032 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 384/817] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:48 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:49.501975 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-77b223f5-fdd6-4295-861b-d3ca6fafd81e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:49.502578 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-77b223f5-fdd6-4295-861b-d3ca6fafd81e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:49.509299 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-77b223f5-fdd6-4295-861b-d3ca6fafd81e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:49.509740 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-77b223f5-fdd6-4295-861b-d3ca6fafd81e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:49.510498 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-77b223f5-fdd6-4295-861b-d3ca6fafd81e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:49.511090 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-77b223f5-fdd6-4295-861b-d3ca6fafd81e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:49.723277 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-77b223f5-fdd6-4295-861b-d3ca6fafd81e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:49.730614 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-77b223f5-fdd6-4295-861b-d3ca6fafd81e tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1521 microversion: 2.1 time: 0.232358 Aug 27 01:34:49.731179 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 434/818] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:49 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:50.044130 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-b7726b62-fab0-485c-a45b-241d32acf8b5 req-d7b5c154-2c62-4f78-a4e6-f1440bdac822 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f0c2a27-bde3-4d4a-894b-be6dc9ed6118", "name": "network-vif-deleted", "tag": "0f68a3b4-5d9c-4b17-875e-e3990c07efa7"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:34:50.047002 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:34:50.047002 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:34:50.058751 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-b7726b62-fab0-485c-a45b-241d32acf8b5 req-d7b5c154-2c62-4f78-a4e6-f1440bdac822 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:50.059398 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-b7726b62-fab0-485c-a45b-241d32acf8b5 req-d7b5c154-2c62-4f78-a4e6-f1440bdac822 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:50.070475 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-b7726b62-fab0-485c-a45b-241d32acf8b5 req-d7b5c154-2c62-4f78-a4e6-f1440bdac822 service nova] Creating event network-vif-deleted:0f68a3b4-5d9c-4b17-875e-e3990c07efa7 for instance 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 on hv-cinder-75916 Aug 27 01:34:50.075232 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-b7726b62-fab0-485c-a45b-241d32acf8b5 req-d7b5c154-2c62-4f78-a4e6-f1440bdac822 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035361 Aug 27 01:34:50.075845 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 385/819] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:34:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:34:50.748078 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-80ddb652-84d2-46eb-bff6-abd19b245829 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:50.748687 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-80ddb652-84d2-46eb-bff6-abd19b245829 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:50.755111 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-80ddb652-84d2-46eb-bff6-abd19b245829 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:50.755549 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-80ddb652-84d2-46eb-bff6-abd19b245829 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:50.756305 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-80ddb652-84d2-46eb-bff6-abd19b245829 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:50.756734 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-80ddb652-84d2-46eb-bff6-abd19b245829 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:50.786414 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-80ddb652-84d2-46eb-bff6-abd19b245829 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:50.786850 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-80ddb652-84d2-46eb-bff6-abd19b245829 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:50.787286 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.objects.instance [None req-80ddb652-84d2-46eb-bff6-abd19b245829 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lazy-loading 'fault' on Instance uuid 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 {{(pid=108755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:34:50.829599 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-80ddb652-84d2-46eb-bff6-abd19b245829 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:50.837094 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-80ddb652-84d2-46eb-bff6-abd19b245829 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1311 microversion: 2.1 time: 0.092517 Aug 27 01:34:50.840573 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 435/820] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:50 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1311 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:51.855994 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-bc762f3d-6156-4e14-8ae5-4d01e5a8bf89 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:51.856687 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-bc762f3d-6156-4e14-8ae5-4d01e5a8bf89 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:51.863716 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bc762f3d-6156-4e14-8ae5-4d01e5a8bf89 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:51.864165 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bc762f3d-6156-4e14-8ae5-4d01e5a8bf89 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:51.864967 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bc762f3d-6156-4e14-8ae5-4d01e5a8bf89 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:51.865405 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bc762f3d-6156-4e14-8ae5-4d01e5a8bf89 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:51.896227 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bc762f3d-6156-4e14-8ae5-4d01e5a8bf89 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:51.896679 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bc762f3d-6156-4e14-8ae5-4d01e5a8bf89 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:51.897158 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.objects.instance [None req-bc762f3d-6156-4e14-8ae5-4d01e5a8bf89 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lazy-loading 'fault' on Instance uuid 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 {{(pid=108756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:34:51.936393 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-bc762f3d-6156-4e14-8ae5-4d01e5a8bf89 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:51.944668 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-bc762f3d-6156-4e14-8ae5-4d01e5a8bf89 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1311 microversion: 2.1 time: 0.093164 Aug 27 01:34:51.945262 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 386/821] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:51 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1311 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:52.960796 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-80bcd569-24f1-4e33-8aa6-b5795dc4f2eb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:52.961430 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-80bcd569-24f1-4e33-8aa6-b5795dc4f2eb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:52.967255 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-80bcd569-24f1-4e33-8aa6-b5795dc4f2eb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:52.968195 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-80bcd569-24f1-4e33-8aa6-b5795dc4f2eb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:52.969006 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-80bcd569-24f1-4e33-8aa6-b5795dc4f2eb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:52.969454 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-80bcd569-24f1-4e33-8aa6-b5795dc4f2eb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:53.000029 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-80bcd569-24f1-4e33-8aa6-b5795dc4f2eb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:53.000695 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-80bcd569-24f1-4e33-8aa6-b5795dc4f2eb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:53.001174 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.objects.instance [None req-80bcd569-24f1-4e33-8aa6-b5795dc4f2eb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lazy-loading 'fault' on Instance uuid 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 {{(pid=108755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:34:53.045808 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-80bcd569-24f1-4e33-8aa6-b5795dc4f2eb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5952a90abc5042f48c9caecd82a0c74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3b4bb0756249d19606e34fca91d4d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:34:53.053569 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-80bcd569-24f1-4e33-8aa6-b5795dc4f2eb tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 200 len: 1311 microversion: 2.1 time: 0.096386 Aug 27 01:34:53.054132 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 436/822] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:52 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:34:54.070832 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-b63ccb75-429a-4411-9e63-55fbfe75bd29 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:54.076010 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-b63ccb75-429a-4411-9e63-55fbfe75bd29 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] [instance: 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:54.077593 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b63ccb75-429a-4411-9e63-55fbfe75bd29 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:54.078043 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b63ccb75-429a-4411-9e63-55fbfe75bd29 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:54.078804 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b63ccb75-429a-4411-9e63-55fbfe75bd29 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:54.079244 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b63ccb75-429a-4411-9e63-55fbfe75bd29 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:54.091872 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.wsgi [None req-b63ccb75-429a-4411-9e63-55fbfe75bd29 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] HTTP exception thrown: Instance 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 could not be found. Aug 27 01:34:54.092459 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-b63ccb75-429a-4411-9e63-55fbfe75bd29 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] Returning 404 to user: Instance 6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 could not be found. {{(pid=108756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:34:54.093846 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-b63ccb75-429a-4411-9e63-55fbfe75bd29 tempest-ServerRescueNegativeTestJSON-16216648 tempest-ServerRescueNegativeTestJSON-16216648-project] 10.222.0.25 "GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118" status: 404 len: 111 microversion: 2.1 time: 0.026649 Aug 27 01:34:54.094349 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 387/823] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:34:54 2021] GET /compute/v2.1/servers/6f0c2a27-bde3-4d4a-894b-be6dc9ed6118 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:34:57.597006 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-c1b7d2e2-d461-4727-b501-21e3fa4f7396 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:34:57.598315 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-c1b7d2e2-d461-4727-b501-21e3fa4f7396 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 3c494433-2508-45e2-8373-13c34a7c565e] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:34:57.608595 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c1b7d2e2-d461-4727-b501-21e3fa4f7396 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:57.608595 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c1b7d2e2-d461-4727-b501-21e3fa4f7396 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:57.608595 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c1b7d2e2-d461-4727-b501-21e3fa4f7396 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:34:57.608595 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c1b7d2e2-d461-4727-b501-21e3fa4f7396 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:34:57.711205 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.objects.instance [None req-c1b7d2e2-d461-4727-b501-21e3fa4f7396 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lazy-loading 'services' on Instance uuid 3c494433-2508-45e2-8373-13c34a7c565e {{(pid=108755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:34:57.979908 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-c1b7d2e2-d461-4727-b501-21e3fa4f7396 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e/os-volume_attachments/949150e2-2722-49e5-b898-a981cbd47f64" status: 202 len: 0 microversion: 2.1 time: 0.386652 Aug 27 01:34:57.980674 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 437/824] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Aug 27 01:34:57 2021] DELETE /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e/os-volume_attachments/949150e2-2722-49e5-b898-a981cbd47f64 => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 01:34:59.522572 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-2fbb156a-26fc-4831-9a80-d72058d5a5ef tempest-VolumesGetTestJSON-247689993 tempest-VolumesGetTestJSON-247689993-project] Action: 'create', calling method: .version_select at 0x7ff2141b0ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1319987940", "metadata": {"Type": "work"}}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:00.126162 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-2fbb156a-26fc-4831-9a80-d72058d5a5ef tempest-VolumesGetTestJSON-247689993 tempest-VolumesGetTestJSON-247689993-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.725197 Aug 27 01:35:00.127027 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 388/825] 10.222.0.25 () {60 vars in 1156 bytes} [Fri Aug 27 01:34:59 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 726 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 27 01:35:00.138093 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-8544cfb2-de6f-4967-a421-fb9e34e7791e tempest-VolumesGetTestJSON-247689993 tempest-VolumesGetTestJSON-247689993-project] Calling method '.version_select at 0x7ff2141b1310>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:00.177893 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-6dff7c59-22b7-42e9-a272-75cf4d004718 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:00.178434 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-6dff7c59-22b7-42e9-a272-75cf4d004718 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 3c494433-2508-45e2-8373-13c34a7c565e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:00.185342 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6dff7c59-22b7-42e9-a272-75cf4d004718 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:00.185785 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6dff7c59-22b7-42e9-a272-75cf4d004718 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:00.187151 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6dff7c59-22b7-42e9-a272-75cf4d004718 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:00.187680 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6dff7c59-22b7-42e9-a272-75cf4d004718 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:00.211447 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-8544cfb2-de6f-4967-a421-fb9e34e7791e tempest-VolumesGetTestJSON-247689993 tempest-VolumesGetTestJSON-247689993-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3cb0d83f-5232-4a78-9afe-56903ef50684" status: 200 len: 353 microversion: 2.1 time: 0.077184 Aug 27 01:35:00.212054 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 438/826] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Aug 27 01:35:00 2021] GET /compute/v2.1/os-volumes/3cb0d83f-5232-4a78-9afe-56903ef50684 => generated 353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:35:00.216722 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-6dff7c59-22b7-42e9-a272-75cf4d004718 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 3c494433-2508-45e2-8373-13c34a7c565e] Going to try to terminate instance {{(pid=108756) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 01:35:00.655868 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-6dff7c59-22b7-42e9-a272-75cf4d004718 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e" status: 204 len: 0 microversion: 2.1 time: 0.480704 Aug 27 01:35:00.656539 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 389/827] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Aug 27 01:35:00 2021] DELETE /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 01:35:00.664801 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-5e5714fc-02c0-4bdc-ab8d-51cd1fd76a02 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:00.665493 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-5e5714fc-02c0-4bdc-ab8d-51cd1fd76a02 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 3c494433-2508-45e2-8373-13c34a7c565e] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:00.671630 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5e5714fc-02c0-4bdc-ab8d-51cd1fd76a02 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:00.672069 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5e5714fc-02c0-4bdc-ab8d-51cd1fd76a02 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:00.672862 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5e5714fc-02c0-4bdc-ab8d-51cd1fd76a02 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:00.673476 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5e5714fc-02c0-4bdc-ab8d-51cd1fd76a02 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:00.796075 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-5e5714fc-02c0-4bdc-ab8d-51cd1fd76a02 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:00.803801 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-5e5714fc-02c0-4bdc-ab8d-51cd1fd76a02 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e" status: 200 len: 1514 microversion: 2.1 time: 0.142900 Aug 27 01:35:00.804352 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 439/828] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:00 2021] GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e => generated 1514 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:01.224585 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-61d99bea-9734-4d60-a05b-430ed7eb691a tempest-VolumesGetTestJSON-247689993 tempest-VolumesGetTestJSON-247689993-project] Calling method '.version_select at 0x7ff2141e9790>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:01.278217 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-61d99bea-9734-4d60-a05b-430ed7eb691a tempest-VolumesGetTestJSON-247689993 tempest-VolumesGetTestJSON-247689993-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3cb0d83f-5232-4a78-9afe-56903ef50684" status: 200 len: 354 microversion: 2.1 time: 0.054474 Aug 27 01:35:01.278217 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 390/829] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Aug 27 01:35:01 2021] GET /compute/v2.1/os-volumes/3cb0d83f-5232-4a78-9afe-56903ef50684 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:35:01.286456 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-accced1b-860c-4e16-9efa-2dcf6ab893a6 tempest-VolumesGetTestJSON-247689993 tempest-VolumesGetTestJSON-247689993-project] Calling method '.version_select at 0x7ff21419b9d0>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:01.338190 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-accced1b-860c-4e16-9efa-2dcf6ab893a6 tempest-VolumesGetTestJSON-247689993 tempest-VolumesGetTestJSON-247689993-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3cb0d83f-5232-4a78-9afe-56903ef50684" status: 200 len: 354 microversion: 2.1 time: 0.055055 Aug 27 01:35:01.338746 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 440/830] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Aug 27 01:35:01 2021] GET /compute/v2.1/os-volumes/3cb0d83f-5232-4a78-9afe-56903ef50684 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:35:01.354344 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-905f191d-70c8-472f-98d6-1239b506b71d tempest-VolumesGetTestJSON-247689993 tempest-VolumesGetTestJSON-247689993-project] Calling method '.version_select at 0x7ff2141b0670>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:01.523113 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-905f191d-70c8-472f-98d6-1239b506b71d tempest-VolumesGetTestJSON-247689993 tempest-VolumesGetTestJSON-247689993-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/3cb0d83f-5232-4a78-9afe-56903ef50684" status: 202 len: 0 microversion: 2.1 time: 0.172360 Aug 27 01:35:01.527352 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 391/831] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Aug 27 01:35:01 2021] DELETE /compute/v2.1/os-volumes/3cb0d83f-5232-4a78-9afe-56903ef50684 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:35:01.531607 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-34e7e200-dc4b-4c86-80de-8a212790aa47 tempest-VolumesGetTestJSON-247689993 tempest-VolumesGetTestJSON-247689993-project] Calling method '.version_select at 0x7ff21419b040>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:01.584747 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-34e7e200-dc4b-4c86-80de-8a212790aa47 tempest-VolumesGetTestJSON-247689993 tempest-VolumesGetTestJSON-247689993-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3cb0d83f-5232-4a78-9afe-56903ef50684" status: 200 len: 353 microversion: 2.1 time: 0.056888 Aug 27 01:35:01.585357 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 441/832] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Aug 27 01:35:01 2021] GET /compute/v2.1/os-volumes/3cb0d83f-5232-4a78-9afe-56903ef50684 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:35:01.821230 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-31ef6c25-b0ec-4a02-b645-89db78ec5393 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:01.821952 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-31ef6c25-b0ec-4a02-b645-89db78ec5393 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 3c494433-2508-45e2-8373-13c34a7c565e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:01.828886 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-31ef6c25-b0ec-4a02-b645-89db78ec5393 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:01.829349 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-31ef6c25-b0ec-4a02-b645-89db78ec5393 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:01.830113 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-31ef6c25-b0ec-4a02-b645-89db78ec5393 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:01.830598 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-31ef6c25-b0ec-4a02-b645-89db78ec5393 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:02.052381 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-31ef6c25-b0ec-4a02-b645-89db78ec5393 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:02.059650 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-31ef6c25-b0ec-4a02-b645-89db78ec5393 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e" status: 200 len: 1514 microversion: 2.1 time: 0.242653 Aug 27 01:35:02.060207 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 392/833] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:01 2021] GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e => generated 1514 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:02.597038 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-cab8d89d-cb1d-45a7-b19c-692373c86357 tempest-VolumesGetTestJSON-247689993 tempest-VolumesGetTestJSON-247689993-project] Calling method '.version_select at 0x7ff2141bd0d0>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:02.622986 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.wsgi [None req-cab8d89d-cb1d-45a7-b19c-692373c86357 tempest-VolumesGetTestJSON-247689993 tempest-VolumesGetTestJSON-247689993-project] HTTP exception thrown: Volume 3cb0d83f-5232-4a78-9afe-56903ef50684 could not be found. Aug 27 01:35:02.623583 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-cab8d89d-cb1d-45a7-b19c-692373c86357 tempest-VolumesGetTestJSON-247689993 tempest-VolumesGetTestJSON-247689993-project] Returning 404 to user: Volume 3cb0d83f-5232-4a78-9afe-56903ef50684 could not be found. {{(pid=108755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:35:02.624956 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-cab8d89d-cb1d-45a7-b19c-692373c86357 tempest-VolumesGetTestJSON-247689993 tempest-VolumesGetTestJSON-247689993-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3cb0d83f-5232-4a78-9afe-56903ef50684" status: 404 len: 109 microversion: 2.1 time: 0.031730 Aug 27 01:35:02.625466 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 442/834] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Aug 27 01:35:02 2021] GET /compute/v2.1/os-volumes/3cb0d83f-5232-4a78-9afe-56903ef50684 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:35:03.079818 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-bead8b96-c821-4737-901c-65d4d7867554 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:03.081077 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-bead8b96-c821-4737-901c-65d4d7867554 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 3c494433-2508-45e2-8373-13c34a7c565e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:03.087225 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bead8b96-c821-4737-901c-65d4d7867554 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:03.087674 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bead8b96-c821-4737-901c-65d4d7867554 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:03.092743 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bead8b96-c821-4737-901c-65d4d7867554 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:03.092743 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bead8b96-c821-4737-901c-65d4d7867554 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:03.236423 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-bead8b96-c821-4737-901c-65d4d7867554 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:03.248416 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-bead8b96-c821-4737-901c-65d4d7867554 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e" status: 200 len: 1514 microversion: 2.1 time: 0.172900 Aug 27 01:35:03.258871 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 393/835] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:03 2021] GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:03.310181 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-88413ab5-b191-4e87-ad4c-a6bdd9946e0f req-52c76cd3-9346-44c7-b8cb-acc2eab3dd5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c494433-2508-45e2-8373-13c34a7c565e", "name": "network-vif-deleted", "tag": "2c66452a-5d7b-476f-b9bc-f96d7b0ab669"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:03.312325 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:35:03.312325 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:35:03.319273 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-88413ab5-b191-4e87-ad4c-a6bdd9946e0f req-52c76cd3-9346-44c7-b8cb-acc2eab3dd5b service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:03.319722 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-88413ab5-b191-4e87-ad4c-a6bdd9946e0f req-52c76cd3-9346-44c7-b8cb-acc2eab3dd5b service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:03.331105 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-88413ab5-b191-4e87-ad4c-a6bdd9946e0f req-52c76cd3-9346-44c7-b8cb-acc2eab3dd5b service nova] Creating event network-vif-deleted:2c66452a-5d7b-476f-b9bc-f96d7b0ab669 for instance 3c494433-2508-45e2-8373-13c34a7c565e on hv-cinder-75916 Aug 27 01:35:03.336949 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-88413ab5-b191-4e87-ad4c-a6bdd9946e0f req-52c76cd3-9346-44c7-b8cb-acc2eab3dd5b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030269 Aug 27 01:35:03.337826 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 443/836] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:35:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:35:04.264767 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-975c8de5-e000-495d-9750-b2c8ca0ba6a8 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:04.265435 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-975c8de5-e000-495d-9750-b2c8ca0ba6a8 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 3c494433-2508-45e2-8373-13c34a7c565e] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:04.271879 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-975c8de5-e000-495d-9750-b2c8ca0ba6a8 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:04.272377 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-975c8de5-e000-495d-9750-b2c8ca0ba6a8 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:04.273135 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-975c8de5-e000-495d-9750-b2c8ca0ba6a8 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:04.273569 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-975c8de5-e000-495d-9750-b2c8ca0ba6a8 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:04.305787 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-975c8de5-e000-495d-9750-b2c8ca0ba6a8 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:04.306228 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-975c8de5-e000-495d-9750-b2c8ca0ba6a8 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:04.306673 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.objects.instance [None req-975c8de5-e000-495d-9750-b2c8ca0ba6a8 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lazy-loading 'fault' on Instance uuid 3c494433-2508-45e2-8373-13c34a7c565e {{(pid=108756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:35:04.350584 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-975c8de5-e000-495d-9750-b2c8ca0ba6a8 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bcad9416ea4ffd966b9827246ef936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0342a0d1e3b49c29852c11d8aeadb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:04.357243 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-975c8de5-e000-495d-9750-b2c8ca0ba6a8 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e" status: 200 len: 1309 microversion: 2.1 time: 0.096195 Aug 27 01:35:04.357798 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 394/837] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:04 2021] GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:05.381336 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-ad101a24-9157-42f0-af3a-753126423837 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:05.382052 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-ad101a24-9157-42f0-af3a-753126423837 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] [instance: 3c494433-2508-45e2-8373-13c34a7c565e] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:05.387988 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ad101a24-9157-42f0-af3a-753126423837 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:05.388439 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ad101a24-9157-42f0-af3a-753126423837 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:05.389776 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ad101a24-9157-42f0-af3a-753126423837 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:05.390312 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ad101a24-9157-42f0-af3a-753126423837 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:05.404048 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.wsgi [None req-ad101a24-9157-42f0-af3a-753126423837 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] HTTP exception thrown: Instance 3c494433-2508-45e2-8373-13c34a7c565e could not be found. Aug 27 01:35:05.404642 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-ad101a24-9157-42f0-af3a-753126423837 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] Returning 404 to user: Instance 3c494433-2508-45e2-8373-13c34a7c565e could not be found. {{(pid=108755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:35:05.406367 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-ad101a24-9157-42f0-af3a-753126423837 tempest-VolumesSnapshotTestJSON-750395629 tempest-VolumesSnapshotTestJSON-750395629-project] 10.222.0.25 "GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e" status: 404 len: 111 microversion: 2.1 time: 0.029055 Aug 27 01:35:05.406927 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 444/838] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:05 2021] GET /compute/v2.1/servers/3c494433-2508-45e2-8373-13c34a7c565e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:35:10.503518 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-bf9dc1dc-df47-47ee-95e5-fcb3de27c3ec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:10.504116 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-bf9dc1dc-df47-47ee-95e5-fcb3de27c3ec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:10.510220 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bf9dc1dc-df47-47ee-95e5-fcb3de27c3ec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:10.510658 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bf9dc1dc-df47-47ee-95e5-fcb3de27c3ec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:10.511416 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bf9dc1dc-df47-47ee-95e5-fcb3de27c3ec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:10.511861 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bf9dc1dc-df47-47ee-95e5-fcb3de27c3ec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:10.539943 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-bf9dc1dc-df47-47ee-95e5-fcb3de27c3ec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/os-volume_attachments/e03ca09f-26cd-4fd2-a172-8a17e21db14e" status: 200 len: 194 microversion: 2.20 time: 0.040250 Aug 27 01:35:10.540506 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 395/839] 10.222.0.25 () {60 vars in 1454 bytes} [Fri Aug 27 01:35:10 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/os-volume_attachments/e03ca09f-26cd-4fd2-a172-8a17e21db14e => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:35:10.609922 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d681aceb-f252-44ae-9a3d-e056d8ffe6d2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:10.610510 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d681aceb-f252-44ae-9a3d-e056d8ffe6d2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:10.616053 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d681aceb-f252-44ae-9a3d-e056d8ffe6d2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:10.620658 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d681aceb-f252-44ae-9a3d-e056d8ffe6d2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:10.620658 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d681aceb-f252-44ae-9a3d-e056d8ffe6d2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:10.620658 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d681aceb-f252-44ae-9a3d-e056d8ffe6d2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:10.707535 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.objects.instance [None req-d681aceb-f252-44ae-9a3d-e056d8ffe6d2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lazy-loading 'services' on Instance uuid 6ec83298-8a1e-4edd-be07-4e0592a0ce04 {{(pid=108755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:35:10.916758 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d681aceb-f252-44ae-9a3d-e056d8ffe6d2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/os-volume_attachments/e03ca09f-26cd-4fd2-a172-8a17e21db14e" status: 202 len: 0 microversion: 2.20 time: 0.310810 Aug 27 01:35:10.917360 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 445/840] 10.222.0.25 () {60 vars in 1457 bytes} [Fri Aug 27 01:35:10 2021] DELETE /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/os-volume_attachments/e03ca09f-26cd-4fd2-a172-8a17e21db14e => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 01:35:10.926104 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-927c9323-b684-4e4b-b52d-abc7d41a5485 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:10.926991 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-927c9323-b684-4e4b-b52d-abc7d41a5485 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:10.933006 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-927c9323-b684-4e4b-b52d-abc7d41a5485 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:10.933457 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-927c9323-b684-4e4b-b52d-abc7d41a5485 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:10.934222 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-927c9323-b684-4e4b-b52d-abc7d41a5485 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:10.934658 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-927c9323-b684-4e4b-b52d-abc7d41a5485 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:10.969012 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-927c9323-b684-4e4b-b52d-abc7d41a5485 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046948 Aug 27 01:35:10.970532 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 396/841] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Aug 27 01:35:10 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:35:11.984112 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-9d91bbbc-c4a8-4dc4-a9f9-838998770ebb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:11.985200 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-9d91bbbc-c4a8-4dc4-a9f9-838998770ebb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:11.991235 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9d91bbbc-c4a8-4dc4-a9f9-838998770ebb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:11.991681 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9d91bbbc-c4a8-4dc4-a9f9-838998770ebb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:11.992443 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9d91bbbc-c4a8-4dc4-a9f9-838998770ebb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:11.992902 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9d91bbbc-c4a8-4dc4-a9f9-838998770ebb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:12.027777 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-9d91bbbc-c4a8-4dc4-a9f9-838998770ebb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047850 Aug 27 01:35:12.028338 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 446/842] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Aug 27 01:35:11 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:35:13.039628 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-cf8f3c02-66cf-4a9f-aa71-b94c9ed4aa95 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:13.040533 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-cf8f3c02-66cf-4a9f-aa71-b94c9ed4aa95 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:13.046335 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cf8f3c02-66cf-4a9f-aa71-b94c9ed4aa95 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:13.046777 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cf8f3c02-66cf-4a9f-aa71-b94c9ed4aa95 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:13.047683 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cf8f3c02-66cf-4a9f-aa71-b94c9ed4aa95 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:13.048334 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cf8f3c02-66cf-4a9f-aa71-b94c9ed4aa95 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:13.078364 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-cf8f3c02-66cf-4a9f-aa71-b94c9ed4aa95 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042628 Aug 27 01:35:13.079213 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 397/843] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Aug 27 01:35:13 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:13.144772 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-85566e65-9eaa-4f8f-807e-cf552a42a783 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:13.145922 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-85566e65-9eaa-4f8f-807e-cf552a42a783 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:13.151813 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-85566e65-9eaa-4f8f-807e-cf552a42a783 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:13.152431 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-85566e65-9eaa-4f8f-807e-cf552a42a783 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:13.153226 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-85566e65-9eaa-4f8f-807e-cf552a42a783 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:13.153652 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-85566e65-9eaa-4f8f-807e-cf552a42a783 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:13.179065 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-85566e65-9eaa-4f8f-807e-cf552a42a783 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Going to try to terminate instance {{(pid=108755) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 01:35:13.466380 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-85566e65-9eaa-4f8f-807e-cf552a42a783 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 204 len: 0 microversion: 2.20 time: 0.325176 Aug 27 01:35:13.467334 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 447/844] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Aug 27 01:35:13 2021] DELETE /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 01:35:13.476823 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-8b3086d3-63f0-499b-8827-425c5e52466b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:13.478118 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-8b3086d3-63f0-499b-8827-425c5e52466b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:13.501002 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8b3086d3-63f0-499b-8827-425c5e52466b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:13.501002 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8b3086d3-63f0-499b-8827-425c5e52466b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:13.501002 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8b3086d3-63f0-499b-8827-425c5e52466b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:13.501002 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8b3086d3-63f0-499b-8827-425c5e52466b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:13.866076 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-8b3086d3-63f0-499b-8827-425c5e52466b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:13.875725 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-8b3086d3-63f0-499b-8827-425c5e52466b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:13.877317 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-8b3086d3-63f0-499b-8827-425c5e52466b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:13.878653 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-8b3086d3-63f0-499b-8827-425c5e52466b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1722 microversion: 2.20 time: 0.406073 Aug 27 01:35:13.879295 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 398/845] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:35:13 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1722 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:35:14.898082 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-098df0d4-b531-416d-b0d3-16bb9d7d1957 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:14.898793 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-098df0d4-b531-416d-b0d3-16bb9d7d1957 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:14.905440 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-098df0d4-b531-416d-b0d3-16bb9d7d1957 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:14.906091 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-098df0d4-b531-416d-b0d3-16bb9d7d1957 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:14.906858 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-098df0d4-b531-416d-b0d3-16bb9d7d1957 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:14.907449 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-098df0d4-b531-416d-b0d3-16bb9d7d1957 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:14.999850 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 01:35:14.999850 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: Fri Aug 27 01:35:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 01:35:15.185631 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-098df0d4-b531-416d-b0d3-16bb9d7d1957 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:15.193870 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-098df0d4-b531-416d-b0d3-16bb9d7d1957 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:15.195286 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-098df0d4-b531-416d-b0d3-16bb9d7d1957 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:15.196406 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-098df0d4-b531-416d-b0d3-16bb9d7d1957 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1722 microversion: 2.20 time: 0.302433 Aug 27 01:35:15.196973 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 448/846] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:35:14 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1722 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:35:16.214410 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-09e47c4b-98d7-4be9-adce-0c39bb525d22 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:16.215901 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-09e47c4b-98d7-4be9-adce-0c39bb525d22 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:16.239942 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-09e47c4b-98d7-4be9-adce-0c39bb525d22 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:16.240361 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-09e47c4b-98d7-4be9-adce-0c39bb525d22 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:16.241184 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-09e47c4b-98d7-4be9-adce-0c39bb525d22 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:16.241704 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-09e47c4b-98d7-4be9-adce-0c39bb525d22 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:16.343841 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-09e47c4b-98d7-4be9-adce-0c39bb525d22 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:16.351706 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-09e47c4b-98d7-4be9-adce-0c39bb525d22 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:16.353234 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-09e47c4b-98d7-4be9-adce-0c39bb525d22 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:16.354366 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-09e47c4b-98d7-4be9-adce-0c39bb525d22 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1655 microversion: 2.20 time: 0.143645 Aug 27 01:35:16.355113 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 399/847] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:35:16 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1655 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:35:16.584930 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-60e61205-8650-48ef-ac37-3f03ed368057 req-4ce8d90b-c8c3-4b6d-9aca-46209e5c5db5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ec83298-8a1e-4edd-be07-4e0592a0ce04", "name": "network-vif-deleted", "tag": "5f7cab4d-54ba-4757-bb8d-1d2f0a14a90e"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:16.587870 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:35:16.587870 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:35:16.598939 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-60e61205-8650-48ef-ac37-3f03ed368057 req-4ce8d90b-c8c3-4b6d-9aca-46209e5c5db5 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:16.599647 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-60e61205-8650-48ef-ac37-3f03ed368057 req-4ce8d90b-c8c3-4b6d-9aca-46209e5c5db5 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:16.614308 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-60e61205-8650-48ef-ac37-3f03ed368057 req-4ce8d90b-c8c3-4b6d-9aca-46209e5c5db5 service nova] Creating event network-vif-deleted:5f7cab4d-54ba-4757-bb8d-1d2f0a14a90e for instance 6ec83298-8a1e-4edd-be07-4e0592a0ce04 on hv-cinder-75916 Aug 27 01:35:16.619539 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-60e61205-8650-48ef-ac37-3f03ed368057 req-4ce8d90b-c8c3-4b6d-9aca-46209e5c5db5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039053 Aug 27 01:35:16.623488 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 449/848] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:35:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:35:17.375244 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-983c242a-3d61-404b-96cc-8320b8a982b2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:17.376002 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-983c242a-3d61-404b-96cc-8320b8a982b2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:17.382352 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-983c242a-3d61-404b-96cc-8320b8a982b2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:17.383067 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-983c242a-3d61-404b-96cc-8320b8a982b2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:17.383913 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-983c242a-3d61-404b-96cc-8320b8a982b2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:17.384649 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-983c242a-3d61-404b-96cc-8320b8a982b2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:17.421432 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-983c242a-3d61-404b-96cc-8320b8a982b2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:17.422079 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-983c242a-3d61-404b-96cc-8320b8a982b2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:17.422713 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.objects.instance [None req-983c242a-3d61-404b-96cc-8320b8a982b2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lazy-loading 'fault' on Instance uuid 6ec83298-8a1e-4edd-be07-4e0592a0ce04 {{(pid=108756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:35:17.466334 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-983c242a-3d61-404b-96cc-8320b8a982b2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:17.474917 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-983c242a-3d61-404b-96cc-8320b8a982b2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:17.476410 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-983c242a-3d61-404b-96cc-8320b8a982b2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:17.477572 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-983c242a-3d61-404b-96cc-8320b8a982b2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 200 len: 1371 microversion: 2.20 time: 0.108288 Aug 27 01:35:17.478595 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 400/849] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:35:17 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 1371 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:35:18.495587 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-87304e4d-94ac-4dd1-9545-ba7e700a9c90 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:18.496268 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-87304e4d-94ac-4dd1-9545-ba7e700a9c90 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:18.502787 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-87304e4d-94ac-4dd1-9545-ba7e700a9c90 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:18.503268 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-87304e4d-94ac-4dd1-9545-ba7e700a9c90 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:18.504026 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-87304e4d-94ac-4dd1-9545-ba7e700a9c90 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:18.504455 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-87304e4d-94ac-4dd1-9545-ba7e700a9c90 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:18.518007 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.wsgi [None req-87304e4d-94ac-4dd1-9545-ba7e700a9c90 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] HTTP exception thrown: Instance 6ec83298-8a1e-4edd-be07-4e0592a0ce04 could not be found. Aug 27 01:35:18.518596 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-87304e4d-94ac-4dd1-9545-ba7e700a9c90 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Returning 404 to user: Instance 6ec83298-8a1e-4edd-be07-4e0592a0ce04 could not be found. {{(pid=108755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:35:18.519398 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-87304e4d-94ac-4dd1-9545-ba7e700a9c90 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 404 len: 111 microversion: 2.20 time: 0.027808 Aug 27 01:35:18.519906 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 450/850] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:35:18 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 01:35:18.534874 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-a3465f59-07b3-48a2-b652-9598d3bfac9e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '.version_select at 0x7ff21416b4c0>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:18.644467 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-a3465f59-07b3-48a2-b652-9598d3bfac9e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-909256293" status: 204 len: 0 microversion: 2.20 time: 0.115013 Aug 27 01:35:18.645225 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 401/851] 10.222.0.25 () {60 vars in 1259 bytes} [Fri Aug 27 01:35:18 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-909256293 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 01:35:19.459614 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-c02a2cf2-653b-444c-8870-901748eea201 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'create', calling method: .version_select at 0x7ff21419b550>, body: {"keypair": {"name": "tempest-keypair-974593180"}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:19.476534 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-c02a2cf2-653b-444c-8870-901748eea201 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Getting quotas for project 9cbe428e1f9c456087aa6ec677fe0330. Resources: {'key_pairs'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:35:19.480280 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-c02a2cf2-653b-444c-8870-901748eea201 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Getting quotas for user 9032bdd7ffde4d3f9b500974a4c17c67 and project 9cbe428e1f9c456087aa6ec677fe0330. Resources: {'key_pairs'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:35:19.697489 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-c02a2cf2-653b-444c-8870-901748eea201 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Getting quotas for project 9cbe428e1f9c456087aa6ec677fe0330. Resources: {'key_pairs'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:35:19.701125 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-c02a2cf2-653b-444c-8870-901748eea201 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Getting quotas for user 9032bdd7ffde4d3f9b500974a4c17c67 and project 9cbe428e1f9c456087aa6ec677fe0330. Resources: {'key_pairs'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:35:19.715476 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-c02a2cf2-653b-444c-8870-901748eea201 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.259583 Aug 27 01:35:19.716054 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 451/852] 10.222.0.25 () {62 vars in 1199 bytes} [Fri Aug 27 01:35:19 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 261 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Aug 27 01:35:22.356892 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-49860c00-729f-409f-bba7-fb5b5f72f353 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1144410231", "imageRef": "6660bea6-dee9-43b4-95ef-29b53e1a2b28", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c8689e3-4506-47c0-a652-97ed18836189"}], "security_groups": [{"name": "tempest-securitygroup--1106218358"}], "key_name": "tempest-keypair-974593180", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:22.463659 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.network.neutron [None req-49860c00-729f-409f-bba7-fb5b5f72f353 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] validate_networks() for [('5c8689e3-4506-47c0-a652-97ed18836189', None, None, None, None, None)] {{(pid=108756) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 01:35:22.955172 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-49860c00-729f-409f-bba7-fb5b5f72f353 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Flavor limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 01:35:22.955816 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-49860c00-729f-409f-bba7-fb5b5f72f353 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Image limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 01:35:22.956300 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-49860c00-729f-409f-bba7-fb5b5f72f353 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Flavor pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 01:35:22.956706 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-49860c00-729f-409f-bba7-fb5b5f72f353 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Image pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 01:35:22.957140 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-49860c00-729f-409f-bba7-fb5b5f72f353 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 01:35:22.966763 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-49860c00-729f-409f-bba7-fb5b5f72f353 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:22.967650 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-49860c00-729f-409f-bba7-fb5b5f72f353 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:22.968488 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-49860c00-729f-409f-bba7-fb5b5f72f353 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:22.969144 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-49860c00-729f-409f-bba7-fb5b5f72f353 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:22.998045 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-49860c00-729f-409f-bba7-fb5b5f72f353 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Getting quotas for project 9cbe428e1f9c456087aa6ec677fe0330. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:35:23.003529 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-49860c00-729f-409f-bba7-fb5b5f72f353 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Getting quotas for user 9032bdd7ffde4d3f9b500974a4c17c67 and project 9cbe428e1f9c456087aa6ec677fe0330. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:35:23.015030 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-49860c00-729f-409f-bba7-fb5b5f72f353 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Going to run 1 instances... {{(pid=108756) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 01:35:23.017892 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-49860c00-729f-409f-bba7-fb5b5f72f353 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6660bea6-dee9-43b4-95ef-29b53e1a2b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 01:35:23.034614 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-7323db8b-84aa-4f03-8c13-04e0d7625627 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:23.036029 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-7323db8b-84aa-4f03-8c13-04e0d7625627 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:23.044482 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7323db8b-84aa-4f03-8c13-04e0d7625627 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:23.044872 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7323db8b-84aa-4f03-8c13-04e0d7625627 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:23.046348 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7323db8b-84aa-4f03-8c13-04e0d7625627 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:23.046747 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7323db8b-84aa-4f03-8c13-04e0d7625627 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:23.090846 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-7323db8b-84aa-4f03-8c13-04e0d7625627 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064469 Aug 27 01:35:23.092514 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 452/853] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:35:23 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 01:35:23.165975 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-49860c00-729f-409f-bba7-fb5b5f72f353 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.813326 Aug 27 01:35:23.166363 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-a216a976-d7c6-4f79-aca0-1c7b512490b5 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:23.166855 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-a216a976-d7c6-4f79-aca0-1c7b512490b5 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:23.166996 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 402/854] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Aug 27 01:35:22 2021] POST /compute/v2.1/servers => generated 402 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 01:35:23.173883 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a216a976-d7c6-4f79-aca0-1c7b512490b5 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:23.174412 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a216a976-d7c6-4f79-aca0-1c7b512490b5 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:23.175617 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a216a976-d7c6-4f79-aca0-1c7b512490b5 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:23.176202 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a216a976-d7c6-4f79-aca0-1c7b512490b5 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:23.177786 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-1c0c93e8-88bb-4bc7-8e3f-50452be65712 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:23.178393 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-1c0c93e8-88bb-4bc7-8e3f-50452be65712 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:23.225800 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-a216a976-d7c6-4f79-aca0-1c7b512490b5 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Going to try to terminate instance {{(pid=108755) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 01:35:23.246107 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-1c0c93e8-88bb-4bc7-8e3f-50452be65712 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:23.255536 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-1c0c93e8-88bb-4bc7-8e3f-50452be65712 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:23.257290 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-1c0c93e8-88bb-4bc7-8e3f-50452be65712 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:23.258606 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-1c0c93e8-88bb-4bc7-8e3f-50452be65712 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1281 microversion: 2.20 time: 0.085196 Aug 27 01:35:23.259303 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 403/855] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:35:23 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1281 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:35:23.603458 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-a216a976-d7c6-4f79-aca0-1c7b512490b5 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "DELETE /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 204 len: 0 microversion: 2.1 time: 0.440473 Aug 27 01:35:23.603987 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 453/856] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Aug 27 01:35:23 2021] DELETE /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 01:35:23.612688 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c1e00f0e-b6f8-4d4a-a47c-2a35396bb82c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:23.615294 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c1e00f0e-b6f8-4d4a-a47c-2a35396bb82c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:23.620216 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c1e00f0e-b6f8-4d4a-a47c-2a35396bb82c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:23.621109 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c1e00f0e-b6f8-4d4a-a47c-2a35396bb82c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:23.621540 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c1e00f0e-b6f8-4d4a-a47c-2a35396bb82c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:23.622150 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c1e00f0e-b6f8-4d4a-a47c-2a35396bb82c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:23.747715 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c1e00f0e-b6f8-4d4a-a47c-2a35396bb82c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:23.756125 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c1e00f0e-b6f8-4d4a-a47c-2a35396bb82c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1672 microversion: 2.1 time: 0.147178 Aug 27 01:35:23.756688 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 404/857] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:23 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:35:24.277677 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-ffc1c15d-d9dd-4e8d-9354-dea6c429d3f2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:24.278493 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-ffc1c15d-d9dd-4e8d-9354-dea6c429d3f2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:24.330646 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-ffc1c15d-d9dd-4e8d-9354-dea6c429d3f2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:24.337636 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-ffc1c15d-d9dd-4e8d-9354-dea6c429d3f2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:24.339123 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-ffc1c15d-d9dd-4e8d-9354-dea6c429d3f2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:24.340182 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-ffc1c15d-d9dd-4e8d-9354-dea6c429d3f2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1281 microversion: 2.20 time: 0.066583 Aug 27 01:35:24.340732 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 454/858] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:35:24 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1281 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:35:24.773305 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-22b9dd81-a452-4347-ac7d-cd634593fd4d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:24.773828 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-22b9dd81-a452-4347-ac7d-cd634593fd4d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:24.780026 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-22b9dd81-a452-4347-ac7d-cd634593fd4d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:24.780474 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-22b9dd81-a452-4347-ac7d-cd634593fd4d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:24.781320 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-22b9dd81-a452-4347-ac7d-cd634593fd4d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:24.781755 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-22b9dd81-a452-4347-ac7d-cd634593fd4d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:24.907057 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-22b9dd81-a452-4347-ac7d-cd634593fd4d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:24.914567 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-22b9dd81-a452-4347-ac7d-cd634593fd4d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1672 microversion: 2.1 time: 0.144959 Aug 27 01:35:24.915133 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 405/859] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:24 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1672 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:25.357444 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-607e5a03-8a30-4319-b6e4-3a2022a112b5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:25.358054 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-607e5a03-8a30-4319-b6e4-3a2022a112b5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:25.364893 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-607e5a03-8a30-4319-b6e4-3a2022a112b5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:25.365337 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-607e5a03-8a30-4319-b6e4-3a2022a112b5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:25.366103 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-607e5a03-8a30-4319-b6e4-3a2022a112b5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:25.366529 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-607e5a03-8a30-4319-b6e4-3a2022a112b5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:25.426941 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-607e5a03-8a30-4319-b6e4-3a2022a112b5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:25.435188 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-607e5a03-8a30-4319-b6e4-3a2022a112b5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:25.436400 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-607e5a03-8a30-4319-b6e4-3a2022a112b5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:25.438360 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-607e5a03-8a30-4319-b6e4-3a2022a112b5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1285 microversion: 2.20 time: 0.084554 Aug 27 01:35:25.438910 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 455/860] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:35:25 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:35:25.931840 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-a76c39d6-4674-4e4a-bd27-256015d19cbd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:25.932552 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-a76c39d6-4674-4e4a-bd27-256015d19cbd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:25.938628 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a76c39d6-4674-4e4a-bd27-256015d19cbd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:25.939074 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a76c39d6-4674-4e4a-bd27-256015d19cbd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:25.939847 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a76c39d6-4674-4e4a-bd27-256015d19cbd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:25.940284 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a76c39d6-4674-4e4a-bd27-256015d19cbd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:26.066795 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-a76c39d6-4674-4e4a-bd27-256015d19cbd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:26.074195 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-a76c39d6-4674-4e4a-bd27-256015d19cbd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1672 microversion: 2.1 time: 0.145888 Aug 27 01:35:26.074760 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 406/861] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:25 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1672 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:26.455687 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-399de55d-c2ce-4220-bc90-88bf741afd4f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:26.456262 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-399de55d-c2ce-4220-bc90-88bf741afd4f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:26.462781 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-399de55d-c2ce-4220-bc90-88bf741afd4f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:26.463235 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-399de55d-c2ce-4220-bc90-88bf741afd4f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:26.464105 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-399de55d-c2ce-4220-bc90-88bf741afd4f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:26.464723 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-399de55d-c2ce-4220-bc90-88bf741afd4f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:26.534033 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-399de55d-c2ce-4220-bc90-88bf741afd4f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:26.543444 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-399de55d-c2ce-4220-bc90-88bf741afd4f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:26.545091 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-399de55d-c2ce-4220-bc90-88bf741afd4f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:26.547670 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-399de55d-c2ce-4220-bc90-88bf741afd4f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1333 microversion: 2.20 time: 0.094787 Aug 27 01:35:26.548262 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 456/862] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:35:26 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1333 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:35:27.091305 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-5ce61248-7a43-4313-bdf9-5c76f8cd67e1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:27.092166 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-5ce61248-7a43-4313-bdf9-5c76f8cd67e1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:27.098752 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5ce61248-7a43-4313-bdf9-5c76f8cd67e1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:27.099202 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5ce61248-7a43-4313-bdf9-5c76f8cd67e1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:27.099969 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5ce61248-7a43-4313-bdf9-5c76f8cd67e1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:27.100397 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5ce61248-7a43-4313-bdf9-5c76f8cd67e1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:27.235201 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-5ce61248-7a43-4313-bdf9-5c76f8cd67e1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:27.242626 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-5ce61248-7a43-4313-bdf9-5c76f8cd67e1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1672 microversion: 2.1 time: 0.154921 Aug 27 01:35:27.253034 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 407/863] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:27 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:27.572527 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-2c0a9d93-9560-4d84-a8e1-f1595eedb701 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:27.573837 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-2c0a9d93-9560-4d84-a8e1-f1595eedb701 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:27.581725 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2c0a9d93-9560-4d84-a8e1-f1595eedb701 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:27.585978 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2c0a9d93-9560-4d84-a8e1-f1595eedb701 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:27.587180 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2c0a9d93-9560-4d84-a8e1-f1595eedb701 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:27.587807 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2c0a9d93-9560-4d84-a8e1-f1595eedb701 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:27.690705 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-2c0a9d93-9560-4d84-a8e1-f1595eedb701 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:27.698817 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-2c0a9d93-9560-4d84-a8e1-f1595eedb701 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:27.700405 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-2c0a9d93-9560-4d84-a8e1-f1595eedb701 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:27.701612 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-2c0a9d93-9560-4d84-a8e1-f1595eedb701 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1339 microversion: 2.20 time: 0.136101 Aug 27 01:35:27.703117 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 457/864] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:35:27 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1339 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:35:28.259508 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-3000d1fb-f4bc-454d-bd19-942845ab8d94 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:28.260230 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-3000d1fb-f4bc-454d-bd19-942845ab8d94 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:28.270263 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3000d1fb-f4bc-454d-bd19-942845ab8d94 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:28.270906 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3000d1fb-f4bc-454d-bd19-942845ab8d94 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:28.271825 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3000d1fb-f4bc-454d-bd19-942845ab8d94 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:28.272141 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3000d1fb-f4bc-454d-bd19-942845ab8d94 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:28.636697 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-3000d1fb-f4bc-454d-bd19-942845ab8d94 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:28.646932 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-3000d1fb-f4bc-454d-bd19-942845ab8d94 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1672 microversion: 2.1 time: 0.391135 Aug 27 01:35:28.647455 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 408/865] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:28 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1672 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:28.724820 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-2e0a2d39-7cbd-49b6-ab88-614c6a3ed5da tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:28.725457 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-2e0a2d39-7cbd-49b6-ab88-614c6a3ed5da tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:28.731460 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2e0a2d39-7cbd-49b6-ab88-614c6a3ed5da tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:28.731965 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2e0a2d39-7cbd-49b6-ab88-614c6a3ed5da tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:28.732971 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2e0a2d39-7cbd-49b6-ab88-614c6a3ed5da tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:28.733408 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2e0a2d39-7cbd-49b6-ab88-614c6a3ed5da tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:29.091488 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-2e0a2d39-7cbd-49b6-ab88-614c6a3ed5da tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:29.101384 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-2e0a2d39-7cbd-49b6-ab88-614c6a3ed5da tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:29.102911 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-2e0a2d39-7cbd-49b6-ab88-614c6a3ed5da tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:29.104190 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-2e0a2d39-7cbd-49b6-ab88-614c6a3ed5da tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1407 microversion: 2.20 time: 0.383534 Aug 27 01:35:29.104737 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 458/866] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:35:28 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1407 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:35:29.670339 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-06fa7f3a-dddb-4bb0-a831-edbdf87c9192 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:29.671701 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-06fa7f3a-dddb-4bb0-a831-edbdf87c9192 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:29.679263 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-06fa7f3a-dddb-4bb0-a831-edbdf87c9192 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:29.680022 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-06fa7f3a-dddb-4bb0-a831-edbdf87c9192 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:29.681096 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-06fa7f3a-dddb-4bb0-a831-edbdf87c9192 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:29.681769 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-06fa7f3a-dddb-4bb0-a831-edbdf87c9192 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:29.742228 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-b6b8c2e0-dadc-413e-9a8c-537969ffd81f req-ce8afbaa-125b-4a8f-b138-e39d1fd0354a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b8f116a-f7c5-4c53-83b6-22034d528599", "tag": "39c29f7a-a8f4-47b8-b7f9-8153941ce167"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:29.745883 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:35:29.745883 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:35:29.754219 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-b6b8c2e0-dadc-413e-9a8c-537969ffd81f req-ce8afbaa-125b-4a8f-b138-e39d1fd0354a service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:29.755152 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-b6b8c2e0-dadc-413e-9a8c-537969ffd81f req-ce8afbaa-125b-4a8f-b138-e39d1fd0354a service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:29.766008 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-06fa7f3a-dddb-4bb0-a831-edbdf87c9192 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:29.776014 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-06fa7f3a-dddb-4bb0-a831-edbdf87c9192 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1604 microversion: 2.1 time: 0.109746 Aug 27 01:35:29.776600 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 409/867] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:29 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1604 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:29.789608 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-b6b8c2e0-dadc-413e-9a8c-537969ffd81f req-ce8afbaa-125b-4a8f-b138-e39d1fd0354a service nova] Creating event network-changed:39c29f7a-a8f4-47b8-b7f9-8153941ce167 for instance 3b8f116a-f7c5-4c53-83b6-22034d528599 on hv-cinder-75916 Aug 27 01:35:29.796250 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-b6b8c2e0-dadc-413e-9a8c-537969ffd81f req-ce8afbaa-125b-4a8f-b138-e39d1fd0354a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066115 Aug 27 01:35:29.798211 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 459/868] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:35:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:35:30.123605 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c10b57f2-3113-4ea3-a97f-6fbdad13df45 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:30.124648 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c10b57f2-3113-4ea3-a97f-6fbdad13df45 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:30.132182 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c10b57f2-3113-4ea3-a97f-6fbdad13df45 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:30.133023 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c10b57f2-3113-4ea3-a97f-6fbdad13df45 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:30.134920 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c10b57f2-3113-4ea3-a97f-6fbdad13df45 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:30.135583 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c10b57f2-3113-4ea3-a97f-6fbdad13df45 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:30.330761 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c10b57f2-3113-4ea3-a97f-6fbdad13df45 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:30.344593 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c10b57f2-3113-4ea3-a97f-6fbdad13df45 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:30.346752 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c10b57f2-3113-4ea3-a97f-6fbdad13df45 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:30.348068 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c10b57f2-3113-4ea3-a97f-6fbdad13df45 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1407 microversion: 2.20 time: 0.229229 Aug 27 01:35:30.348780 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 410/869] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:35:30 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:35:30.794196 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4c04ea97-41e5-4c6c-9cc9-eba1f15edee2 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:30.795562 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4c04ea97-41e5-4c6c-9cc9-eba1f15edee2 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:30.802541 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4c04ea97-41e5-4c6c-9cc9-eba1f15edee2 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:30.802999 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4c04ea97-41e5-4c6c-9cc9-eba1f15edee2 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:30.803783 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4c04ea97-41e5-4c6c-9cc9-eba1f15edee2 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:30.804220 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4c04ea97-41e5-4c6c-9cc9-eba1f15edee2 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:30.841720 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4c04ea97-41e5-4c6c-9cc9-eba1f15edee2 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:30.842168 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4c04ea97-41e5-4c6c-9cc9-eba1f15edee2 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:30.842853 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.objects.instance [None req-4c04ea97-41e5-4c6c-9cc9-eba1f15edee2 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lazy-loading 'fault' on Instance uuid be807b17-abdc-4d79-b58d-b42998cdb479 {{(pid=108755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:35:30.900278 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4c04ea97-41e5-4c6c-9cc9-eba1f15edee2 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:30.909302 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4c04ea97-41e5-4c6c-9cc9-eba1f15edee2 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 200 len: 1326 microversion: 2.1 time: 0.118881 Aug 27 01:35:30.910120 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 460/870] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:30 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 1326 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:31.371387 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-0859caac-129a-4c33-b38a-edb7d0338b38 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:31.372084 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-0859caac-129a-4c33-b38a-edb7d0338b38 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:31.378084 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0859caac-129a-4c33-b38a-edb7d0338b38 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:31.378532 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0859caac-129a-4c33-b38a-edb7d0338b38 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:31.379297 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0859caac-129a-4c33-b38a-edb7d0338b38 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:31.379735 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0859caac-129a-4c33-b38a-edb7d0338b38 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:31.518603 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0859caac-129a-4c33-b38a-edb7d0338b38 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:31.537340 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0859caac-129a-4c33-b38a-edb7d0338b38 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:31.537340 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0859caac-129a-4c33-b38a-edb7d0338b38 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:31.537340 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-0859caac-129a-4c33-b38a-edb7d0338b38 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1407 microversion: 2.20 time: 0.161752 Aug 27 01:35:31.537718 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 411/871] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:35:31 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:35:31.818218 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-21927d77-86a7-41a2-bd58-6f5fc01aa496 req-ed9943b1-8949-473d-b425-f4bd22e47616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be807b17-abdc-4d79-b58d-b42998cdb479", "name": "network-vif-deleted", "tag": "f18d8c2b-ab08-4402-a440-92bdcf75c38a"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:31.819695 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:35:31.819695 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:35:31.826460 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-21927d77-86a7-41a2-bd58-6f5fc01aa496 req-ed9943b1-8949-473d-b425-f4bd22e47616 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:31.826897 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-21927d77-86a7-41a2-bd58-6f5fc01aa496 req-ed9943b1-8949-473d-b425-f4bd22e47616 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:31.838028 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-21927d77-86a7-41a2-bd58-6f5fc01aa496 req-ed9943b1-8949-473d-b425-f4bd22e47616 service nova] Creating event network-vif-deleted:f18d8c2b-ab08-4402-a440-92bdcf75c38a for instance be807b17-abdc-4d79-b58d-b42998cdb479 on hv-cinder-75916 Aug 27 01:35:31.849311 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-21927d77-86a7-41a2-bd58-6f5fc01aa496 req-ed9943b1-8949-473d-b425-f4bd22e47616 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028151 Aug 27 01:35:31.849311 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 461/872] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:35:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:35:31.930607 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-6522a9f2-51c3-416b-9813-fecd9be6476f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:31.931218 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-6522a9f2-51c3-416b-9813-fecd9be6476f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:31.937925 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6522a9f2-51c3-416b-9813-fecd9be6476f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:31.938438 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6522a9f2-51c3-416b-9813-fecd9be6476f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:31.939217 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6522a9f2-51c3-416b-9813-fecd9be6476f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:31.939655 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6522a9f2-51c3-416b-9813-fecd9be6476f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:31.953417 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.wsgi [None req-6522a9f2-51c3-416b-9813-fecd9be6476f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] HTTP exception thrown: Instance be807b17-abdc-4d79-b58d-b42998cdb479 could not be found. Aug 27 01:35:31.954014 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-6522a9f2-51c3-416b-9813-fecd9be6476f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Returning 404 to user: Instance be807b17-abdc-4d79-b58d-b42998cdb479 could not be found. {{(pid=108756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:35:31.954839 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-6522a9f2-51c3-416b-9813-fecd9be6476f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 404 len: 111 microversion: 2.1 time: 0.031846 Aug 27 01:35:31.955388 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 412/873] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:31 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:35:31.964131 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-adaf355f-ef2e-4a1d-a924-42e2bd3c7d8b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '.version_select at 0x7ff21419b4c0>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:32.044449 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-adaf355f-ef2e-4a1d-a924-42e2bd3c7d8b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-913254760" status: 202 len: 0 microversion: 2.1 time: 0.084270 Aug 27 01:35:32.045061 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 462/874] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Aug 27 01:35:31 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-913254760 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:35:32.549177 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c6b84490-81fd-4a4d-af99-ad7b8a28555d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:32.550300 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c6b84490-81fd-4a4d-af99-ad7b8a28555d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:32.563312 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c6b84490-81fd-4a4d-af99-ad7b8a28555d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:32.566433 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c6b84490-81fd-4a4d-af99-ad7b8a28555d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:32.568848 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c6b84490-81fd-4a4d-af99-ad7b8a28555d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:32.569434 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c6b84490-81fd-4a4d-af99-ad7b8a28555d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:32.742056 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c6b84490-81fd-4a4d-af99-ad7b8a28555d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:32.753803 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c6b84490-81fd-4a4d-af99-ad7b8a28555d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:32.755726 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c6b84490-81fd-4a4d-af99-ad7b8a28555d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:32.757118 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c6b84490-81fd-4a4d-af99-ad7b8a28555d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1407 microversion: 2.20 time: 0.212156 Aug 27 01:35:32.758074 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 413/875] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:35:32 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:35:32.974858 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-079c8069-8390-47ef-b3b0-9a68376bc8e4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'create', calling method: .version_select at 0x7ff2141b1a60>, body: {"keypair": {"name": "tempest-keypair-2109729856"}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:32.996145 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-079c8069-8390-47ef-b3b0-9a68376bc8e4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Getting quotas for project 1d392d1b39ee49d1b87211d5c447f9dc. Resources: {'key_pairs'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:35:33.000017 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-079c8069-8390-47ef-b3b0-9a68376bc8e4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Getting quotas for user fa605019ca5c40d897cb30c990710ff6 and project 1d392d1b39ee49d1b87211d5c447f9dc. Resources: {'key_pairs'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:35:33.445945 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-079c8069-8390-47ef-b3b0-9a68376bc8e4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Getting quotas for project 1d392d1b39ee49d1b87211d5c447f9dc. Resources: {'key_pairs'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:35:33.449580 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-079c8069-8390-47ef-b3b0-9a68376bc8e4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Getting quotas for user fa605019ca5c40d897cb30c990710ff6 and project 1d392d1b39ee49d1b87211d5c447f9dc. Resources: {'key_pairs'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:35:33.463474 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-079c8069-8390-47ef-b3b0-9a68376bc8e4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.493328 Aug 27 01:35:33.464063 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 463/876] 10.222.0.25 () {60 vars in 1158 bytes} [Fri Aug 27 01:35:32 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:33.775684 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-eb26483a-65be-4acc-a87c-dafab42197cf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:33.776280 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-eb26483a-65be-4acc-a87c-dafab42197cf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:33.782192 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-eb26483a-65be-4acc-a87c-dafab42197cf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:33.782640 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-eb26483a-65be-4acc-a87c-dafab42197cf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:33.783702 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-eb26483a-65be-4acc-a87c-dafab42197cf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:33.784348 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-eb26483a-65be-4acc-a87c-dafab42197cf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:33.913123 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-eb26483a-65be-4acc-a87c-dafab42197cf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:33.920953 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-eb26483a-65be-4acc-a87c-dafab42197cf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:33.922968 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-eb26483a-65be-4acc-a87c-dafab42197cf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:33.924037 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-eb26483a-65be-4acc-a87c-dafab42197cf tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1407 microversion: 2.20 time: 0.152450 Aug 27 01:35:33.924620 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 414/877] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:35:33 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:35:34.833652 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-6c03987a-3f58-4356-abac-8a1fc0ac95fb req-bad5c7a8-0206-44a1-aeac-fa87a2baaaf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b8f116a-f7c5-4c53-83b6-22034d528599", "name": "network-vif-plugged", "status": "completed", "tag": "39c29f7a-a8f4-47b8-b7f9-8153941ce167"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:34.837459 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:35:34.837459 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:35:34.842664 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-6c03987a-3f58-4356-abac-8a1fc0ac95fb req-bad5c7a8-0206-44a1-aeac-fa87a2baaaf6 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:34.843359 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-6c03987a-3f58-4356-abac-8a1fc0ac95fb req-bad5c7a8-0206-44a1-aeac-fa87a2baaaf6 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:34.853739 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-6c03987a-3f58-4356-abac-8a1fc0ac95fb req-bad5c7a8-0206-44a1-aeac-fa87a2baaaf6 service nova] Creating event network-vif-plugged:39c29f7a-a8f4-47b8-b7f9-8153941ce167 for instance 3b8f116a-f7c5-4c53-83b6-22034d528599 on hv-cinder-75916 Aug 27 01:35:34.858905 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-6c03987a-3f58-4356-abac-8a1fc0ac95fb req-bad5c7a8-0206-44a1-aeac-fa87a2baaaf6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028670 Aug 27 01:35:34.860478 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 464/878] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:35:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:35:34.944008 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-b238bfd8-0144-408c-92ff-d7294f786dc5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:34.945311 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-b238bfd8-0144-408c-92ff-d7294f786dc5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:34.954000 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b238bfd8-0144-408c-92ff-d7294f786dc5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:34.954446 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b238bfd8-0144-408c-92ff-d7294f786dc5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:34.955286 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b238bfd8-0144-408c-92ff-d7294f786dc5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:34.955719 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b238bfd8-0144-408c-92ff-d7294f786dc5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:35.115849 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-b238bfd8-0144-408c-92ff-d7294f786dc5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:35.123676 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-b238bfd8-0144-408c-92ff-d7294f786dc5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:35.125387 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-b238bfd8-0144-408c-92ff-d7294f786dc5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:35.126507 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-b238bfd8-0144-408c-92ff-d7294f786dc5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1407 microversion: 2.20 time: 0.187634 Aug 27 01:35:35.127061 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 415/879] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:35:34 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:35:36.147934 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-091368a2-8a94-411b-abe1-bbedbcf1082f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:36.150588 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-091368a2-8a94-411b-abe1-bbedbcf1082f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:36.159173 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-091368a2-8a94-411b-abe1-bbedbcf1082f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:36.159837 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-091368a2-8a94-411b-abe1-bbedbcf1082f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:36.160767 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-091368a2-8a94-411b-abe1-bbedbcf1082f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:36.161617 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-091368a2-8a94-411b-abe1-bbedbcf1082f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:36.335106 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-091368a2-8a94-411b-abe1-bbedbcf1082f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:36.340390 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-091368a2-8a94-411b-abe1-bbedbcf1082f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:36.349466 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-091368a2-8a94-411b-abe1-bbedbcf1082f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:36.350711 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-091368a2-8a94-411b-abe1-bbedbcf1082f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1407 microversion: 2.20 time: 0.208916 Aug 27 01:35:36.362828 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 465/880] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:35:36 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:35:36.537122 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-098ee03a-9534-4ac9-b8d1-4261f31d8a30 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1113408291", "imageRef": "6660bea6-dee9-43b4-95ef-29b53e1a2b28", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6cba5cc2-c26d-402b-a305-3f91c04ec99b"}], "security_groups": [{"name": "tempest-securitygroup--1283280788"}], "key_name": "tempest-keypair-2109729856", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:36.634290 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.network.neutron [None req-098ee03a-9534-4ac9-b8d1-4261f31d8a30 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] validate_networks() for [('6cba5cc2-c26d-402b-a305-3f91c04ec99b', None, None, None, None, None)] {{(pid=108756) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 01:35:37.105533 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-098ee03a-9534-4ac9-b8d1-4261f31d8a30 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Flavor limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 01:35:37.105952 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-098ee03a-9534-4ac9-b8d1-4261f31d8a30 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Image limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 01:35:37.106449 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-098ee03a-9534-4ac9-b8d1-4261f31d8a30 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Flavor pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 01:35:37.106850 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-098ee03a-9534-4ac9-b8d1-4261f31d8a30 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Image pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 01:35:37.107262 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-098ee03a-9534-4ac9-b8d1-4261f31d8a30 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 01:35:37.116201 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-098ee03a-9534-4ac9-b8d1-4261f31d8a30 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:37.116643 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-098ee03a-9534-4ac9-b8d1-4261f31d8a30 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:37.117484 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-098ee03a-9534-4ac9-b8d1-4261f31d8a30 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:37.117945 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-098ee03a-9534-4ac9-b8d1-4261f31d8a30 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:37.135387 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-098ee03a-9534-4ac9-b8d1-4261f31d8a30 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Getting quotas for project 1d392d1b39ee49d1b87211d5c447f9dc. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:35:37.139111 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-098ee03a-9534-4ac9-b8d1-4261f31d8a30 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Getting quotas for user fa605019ca5c40d897cb30c990710ff6 and project 1d392d1b39ee49d1b87211d5c447f9dc. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:35:37.151426 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-098ee03a-9534-4ac9-b8d1-4261f31d8a30 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Going to run 1 instances... {{(pid=108756) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 01:35:37.153529 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-098ee03a-9534-4ac9-b8d1-4261f31d8a30 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6660bea6-dee9-43b4-95ef-29b53e1a2b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 01:35:37.290646 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-098ee03a-9534-4ac9-b8d1-4261f31d8a30 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.764388 Aug 27 01:35:37.291306 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 416/881] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Aug 27 01:35:36 2021] POST /compute/v2.1/servers => generated 402 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 01:35:37.301326 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-19fedd03-5e03-46c0-9cfa-a4a6011403db tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:37.301933 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-19fedd03-5e03-46c0-9cfa-a4a6011403db tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:37.357919 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-19fedd03-5e03-46c0-9cfa-a4a6011403db tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:37.372100 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-19fedd03-5e03-46c0-9cfa-a4a6011403db tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 200 len: 1238 microversion: 2.1 time: 0.074455 Aug 27 01:35:37.381994 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 466/882] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:37 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 1238 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:37.382445 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-e0967f55-d5ec-4768-84ba-0557c940430f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:37.382445 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-e0967f55-d5ec-4768-84ba-0557c940430f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:37.387909 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e0967f55-d5ec-4768-84ba-0557c940430f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:37.388500 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e0967f55-d5ec-4768-84ba-0557c940430f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:37.389332 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e0967f55-d5ec-4768-84ba-0557c940430f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:37.389814 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e0967f55-d5ec-4768-84ba-0557c940430f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:37.538631 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-e0967f55-d5ec-4768-84ba-0557c940430f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:37.549200 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-e0967f55-d5ec-4768-84ba-0557c940430f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:37.551073 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-e0967f55-d5ec-4768-84ba-0557c940430f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:37.552374 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-e0967f55-d5ec-4768-84ba-0557c940430f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1599 microversion: 2.20 time: 0.185312 Aug 27 01:35:37.556870 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 417/883] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:35:37 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1599 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:35:37.571072 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-9375a6f6-bac2-4825-90e6-6411f51489aa tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:37.572021 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-9375a6f6-bac2-4825-90e6-6411f51489aa tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:37.578122 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9375a6f6-bac2-4825-90e6-6411f51489aa tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:37.578575 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9375a6f6-bac2-4825-90e6-6411f51489aa tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:37.579353 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9375a6f6-bac2-4825-90e6-6411f51489aa tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:37.579790 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9375a6f6-bac2-4825-90e6-6411f51489aa tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:37.672870 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-9375a6f6-bac2-4825-90e6-6411f51489aa tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.105507 Aug 27 01:35:37.677608 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 467/884] 10.222.0.25 () {60 vars in 1316 bytes} [Fri Aug 27 01:35:37 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:35:38.405320 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-b54102e3-00d7-4fbe-8ab5-54ef994ca86a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:38.406995 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-b54102e3-00d7-4fbe-8ab5-54ef994ca86a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:38.425984 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b54102e3-00d7-4fbe-8ab5-54ef994ca86a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:38.426703 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b54102e3-00d7-4fbe-8ab5-54ef994ca86a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:38.428031 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b54102e3-00d7-4fbe-8ab5-54ef994ca86a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:38.428690 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b54102e3-00d7-4fbe-8ab5-54ef994ca86a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:38.490776 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-b54102e3-00d7-4fbe-8ab5-54ef994ca86a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:38.500649 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-b54102e3-00d7-4fbe-8ab5-54ef994ca86a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 200 len: 1242 microversion: 2.1 time: 0.115569 Aug 27 01:35:38.506167 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 418/885] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:38 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 1242 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:39.259240 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d53024d4-4105-4290-bf26-eaf0a48c5e86 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:39.260970 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d53024d4-4105-4290-bf26-eaf0a48c5e86 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:39.266718 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-5eee1a6e-0551-412b-88be-d347aa406ea7 req-5ec1630f-d885-4d06-86f3-5604b7c86d97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b8f116a-f7c5-4c53-83b6-22034d528599", "tag": "39c29f7a-a8f4-47b8-b7f9-8153941ce167"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:39.268878 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:35:39.268878 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:35:39.270197 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d53024d4-4105-4290-bf26-eaf0a48c5e86 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:39.271045 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d53024d4-4105-4290-bf26-eaf0a48c5e86 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:39.272824 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d53024d4-4105-4290-bf26-eaf0a48c5e86 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:39.273456 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d53024d4-4105-4290-bf26-eaf0a48c5e86 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:39.275852 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-5eee1a6e-0551-412b-88be-d347aa406ea7 req-5ec1630f-d885-4d06-86f3-5604b7c86d97 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:39.279829 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-5eee1a6e-0551-412b-88be-d347aa406ea7 req-5ec1630f-d885-4d06-86f3-5604b7c86d97 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:39.293606 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-5eee1a6e-0551-412b-88be-d347aa406ea7 req-5ec1630f-d885-4d06-86f3-5604b7c86d97 service nova] Creating event network-changed:39c29f7a-a8f4-47b8-b7f9-8153941ce167 for instance 3b8f116a-f7c5-4c53-83b6-22034d528599 on hv-cinder-75916 Aug 27 01:35:39.300010 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-5eee1a6e-0551-412b-88be-d347aa406ea7 req-5ec1630f-d885-4d06-86f3-5604b7c86d97 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042916 Aug 27 01:35:39.301532 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 419/886] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:35:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:35:39.394019 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d53024d4-4105-4290-bf26-eaf0a48c5e86 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 200 len: 14 microversion: 2.20 time: 0.139997 Aug 27 01:35:39.394817 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 468/887] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:35:39 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:39.519442 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c91903b6-3b7b-4b9f-a0f7-3ea34fa407c3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:39.520037 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c91903b6-3b7b-4b9f-a0f7-3ea34fa407c3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:39.526804 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c91903b6-3b7b-4b9f-a0f7-3ea34fa407c3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:39.527602 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c91903b6-3b7b-4b9f-a0f7-3ea34fa407c3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:39.528470 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c91903b6-3b7b-4b9f-a0f7-3ea34fa407c3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:39.529127 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c91903b6-3b7b-4b9f-a0f7-3ea34fa407c3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:39.633419 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c91903b6-3b7b-4b9f-a0f7-3ea34fa407c3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:39.644458 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c91903b6-3b7b-4b9f-a0f7-3ea34fa407c3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 200 len: 1290 microversion: 2.1 time: 0.129867 Aug 27 01:35:39.645330 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 420/888] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:39 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 1290 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:40.405362 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d33cdc76-cdd0-48ed-961d-35da11189def tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:40.408030 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d33cdc76-cdd0-48ed-961d-35da11189def tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:40.426063 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d33cdc76-cdd0-48ed-961d-35da11189def tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:40.426063 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d33cdc76-cdd0-48ed-961d-35da11189def tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:40.426063 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d33cdc76-cdd0-48ed-961d-35da11189def tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:40.426063 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d33cdc76-cdd0-48ed-961d-35da11189def tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:40.520420 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d33cdc76-cdd0-48ed-961d-35da11189def tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 200 len: 14 microversion: 2.20 time: 0.119111 Aug 27 01:35:40.522595 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 469/889] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:35:40 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:40.664302 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-efa8f83f-6209-46bf-9023-02a7678fc70a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:40.664302 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-efa8f83f-6209-46bf-9023-02a7678fc70a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:40.676466 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-efa8f83f-6209-46bf-9023-02a7678fc70a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:40.676947 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-efa8f83f-6209-46bf-9023-02a7678fc70a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:40.684025 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-efa8f83f-6209-46bf-9023-02a7678fc70a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:40.685965 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-efa8f83f-6209-46bf-9023-02a7678fc70a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:40.819832 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-efa8f83f-6209-46bf-9023-02a7678fc70a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:40.830866 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-efa8f83f-6209-46bf-9023-02a7678fc70a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 200 len: 1296 microversion: 2.1 time: 0.170590 Aug 27 01:35:40.831428 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 421/890] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:40 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 1296 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:41.536815 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-705e8384-082b-4a1a-9be3-2ca9b3495283 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:41.538031 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-705e8384-082b-4a1a-9be3-2ca9b3495283 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:41.550060 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-705e8384-082b-4a1a-9be3-2ca9b3495283 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:41.550883 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-705e8384-082b-4a1a-9be3-2ca9b3495283 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:41.551886 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-705e8384-082b-4a1a-9be3-2ca9b3495283 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:41.552561 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-705e8384-082b-4a1a-9be3-2ca9b3495283 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:41.646924 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-705e8384-082b-4a1a-9be3-2ca9b3495283 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 200 len: 14 microversion: 2.20 time: 0.114063 Aug 27 01:35:41.650958 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 470/891] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:35:41 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:41.848673 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ef8ee2ae-dfc7-4515-9e36-f7c72cdab21d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:41.850274 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-ef8ee2ae-dfc7-4515-9e36-f7c72cdab21d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:41.878945 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ef8ee2ae-dfc7-4515-9e36-f7c72cdab21d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:41.879588 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ef8ee2ae-dfc7-4515-9e36-f7c72cdab21d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:41.880802 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ef8ee2ae-dfc7-4515-9e36-f7c72cdab21d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:41.881500 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ef8ee2ae-dfc7-4515-9e36-f7c72cdab21d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:42.235782 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ef8ee2ae-dfc7-4515-9e36-f7c72cdab21d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:42.246223 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-ef8ee2ae-dfc7-4515-9e36-f7c72cdab21d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 200 len: 1364 microversion: 2.1 time: 0.401195 Aug 27 01:35:42.248883 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 422/892] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:41 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 1364 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:42.662786 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-80bed71f-eb1a-479a-b77a-2be6b72abd91 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:42.667010 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-80bed71f-eb1a-479a-b77a-2be6b72abd91 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:42.673474 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-80bed71f-eb1a-479a-b77a-2be6b72abd91 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:42.674095 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-80bed71f-eb1a-479a-b77a-2be6b72abd91 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:42.675265 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-80bed71f-eb1a-479a-b77a-2be6b72abd91 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:42.677501 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-80bed71f-eb1a-479a-b77a-2be6b72abd91 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:42.776571 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-80bed71f-eb1a-479a-b77a-2be6b72abd91 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 200 len: 14 microversion: 2.20 time: 0.120519 Aug 27 01:35:42.776877 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 423/893] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:35:42 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:35:42.798019 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-18282a18-1bc1-44e7-89bc-679a59cccf27 req-aef603c5-d761-40d0-b85c-bf883774bc79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4270f24-9903-4782-8633-a676243368a6", "tag": "043fb403-1255-4b2f-94a3-72fd35ade4a5"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:42.800492 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:35:42.800492 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:35:42.809390 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-18282a18-1bc1-44e7-89bc-679a59cccf27 req-aef603c5-d761-40d0-b85c-bf883774bc79 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:42.809841 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-18282a18-1bc1-44e7-89bc-679a59cccf27 req-aef603c5-d761-40d0-b85c-bf883774bc79 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:42.834521 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-18282a18-1bc1-44e7-89bc-679a59cccf27 req-aef603c5-d761-40d0-b85c-bf883774bc79 service nova] Creating event network-changed:043fb403-1255-4b2f-94a3-72fd35ade4a5 for instance e4270f24-9903-4782-8633-a676243368a6 on hv-cinder-75916 Aug 27 01:35:42.841236 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-18282a18-1bc1-44e7-89bc-679a59cccf27 req-aef603c5-d761-40d0-b85c-bf883774bc79 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.240533 Aug 27 01:35:42.842327 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 471/894] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:35:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:35:43.011024 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-6f223145-4449-4d92-9125-1a4b55b8d812 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-629803228", "imageRef": "6660bea6-dee9-43b4-95ef-29b53e1a2b28", "flavorRef": "452", "networks": [{"uuid": "0788b1ad-cd04-4b18-949e-72f4f8f536f9"}]}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:43.073763 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.network.neutron [None req-6f223145-4449-4d92-9125-1a4b55b8d812 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] validate_networks() for [('0788b1ad-cd04-4b18-949e-72f4f8f536f9', None, None, None, None, None)] {{(pid=108756) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 01:35:43.267935 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-7ec67b2c-b1ca-4392-b019-48d8f53717d7 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:43.269020 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-7ec67b2c-b1ca-4392-b019-48d8f53717d7 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:43.279192 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7ec67b2c-b1ca-4392-b019-48d8f53717d7 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:43.280004 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7ec67b2c-b1ca-4392-b019-48d8f53717d7 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:43.281374 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7ec67b2c-b1ca-4392-b019-48d8f53717d7 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:43.282151 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7ec67b2c-b1ca-4392-b019-48d8f53717d7 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:43.595927 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-7ec67b2c-b1ca-4392-b019-48d8f53717d7 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:43.607826 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-7ec67b2c-b1ca-4392-b019-48d8f53717d7 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 200 len: 1364 microversion: 2.1 time: 0.344422 Aug 27 01:35:43.610569 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 472/895] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:43 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 1364 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:35:43.787644 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-1934cf94-a095-484c-91f3-97a6eb123d89 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:43.788550 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-1934cf94-a095-484c-91f3-97a6eb123d89 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:43.804576 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1934cf94-a095-484c-91f3-97a6eb123d89 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:43.805235 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1934cf94-a095-484c-91f3-97a6eb123d89 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:43.805862 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1934cf94-a095-484c-91f3-97a6eb123d89 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:43.806307 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1934cf94-a095-484c-91f3-97a6eb123d89 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:43.873515 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-6f223145-4449-4d92-9125-1a4b55b8d812 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Flavor limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 01:35:43.873515 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-6f223145-4449-4d92-9125-1a4b55b8d812 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Image limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 01:35:43.873515 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-6f223145-4449-4d92-9125-1a4b55b8d812 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Flavor pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 01:35:43.873515 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-6f223145-4449-4d92-9125-1a4b55b8d812 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Image pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 01:35:43.873515 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-6f223145-4449-4d92-9125-1a4b55b8d812 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 01:35:43.888229 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6f223145-4449-4d92-9125-1a4b55b8d812 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:43.889012 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6f223145-4449-4d92-9125-1a4b55b8d812 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:43.890916 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6f223145-4449-4d92-9125-1a4b55b8d812 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:43.891977 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6f223145-4449-4d92-9125-1a4b55b8d812 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:43.914711 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-6f223145-4449-4d92-9125-1a4b55b8d812 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Getting quotas for project 31b47b7bf2ed4568af16eb7861b78453. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:35:43.915523 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-1934cf94-a095-484c-91f3-97a6eb123d89 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 200 len: 14 microversion: 2.20 time: 0.132131 Aug 27 01:35:43.916418 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 473/896] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:35:43 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:43.919465 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-6f223145-4449-4d92-9125-1a4b55b8d812 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Getting quotas for user b2a94d8d27de4c9db7b8f2b1285058ac and project 31b47b7bf2ed4568af16eb7861b78453. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:35:43.934215 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-6f223145-4449-4d92-9125-1a4b55b8d812 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Going to run 1 instances... {{(pid=108756) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 01:35:43.939530 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-6f223145-4449-4d92-9125-1a4b55b8d812 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 03bed1c0-44d0-4815-8f32-5a2ae2a98987] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6660bea6-dee9-43b4-95ef-29b53e1a2b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 01:35:44.098849 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-6f223145-4449-4d92-9125-1a4b55b8d812 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.091498 Aug 27 01:35:44.104492 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 424/897] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Aug 27 01:35:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 01:35:44.110169 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-9410ad9b-8c76-4fd4-a87d-d918efe194b4 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:44.113395 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-9410ad9b-8c76-4fd4-a87d-d918efe194b4 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 03bed1c0-44d0-4815-8f32-5a2ae2a98987] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:44.253789 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-9410ad9b-8c76-4fd4-a87d-d918efe194b4 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:44.265492 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-9410ad9b-8c76-4fd4-a87d-d918efe194b4 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987" status: 200 len: 1213 microversion: 2.1 time: 0.159058 Aug 27 01:35:44.278001 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 474/898] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:44 2021] GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987 => generated 1213 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:35:44.627021 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c84647fd-e157-485a-8ed0-1f334344b955 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:44.627637 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c84647fd-e157-485a-8ed0-1f334344b955 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:44.637914 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c84647fd-e157-485a-8ed0-1f334344b955 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:44.639455 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c84647fd-e157-485a-8ed0-1f334344b955 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:44.642986 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c84647fd-e157-485a-8ed0-1f334344b955 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:44.643650 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c84647fd-e157-485a-8ed0-1f334344b955 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:44.816908 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c84647fd-e157-485a-8ed0-1f334344b955 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:44.824580 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c84647fd-e157-485a-8ed0-1f334344b955 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 200 len: 1364 microversion: 2.1 time: 0.201672 Aug 27 01:35:44.825173 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 425/899] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:44 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 1364 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:44.927893 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-43e81075-fc2b-4aaa-9700-58ab8a2c123b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:44.929124 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-43e81075-fc2b-4aaa-9700-58ab8a2c123b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:44.944892 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-43e81075-fc2b-4aaa-9700-58ab8a2c123b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:44.945759 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-43e81075-fc2b-4aaa-9700-58ab8a2c123b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:44.948638 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-43e81075-fc2b-4aaa-9700-58ab8a2c123b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:44.950895 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-43e81075-fc2b-4aaa-9700-58ab8a2c123b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:45.055101 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-43e81075-fc2b-4aaa-9700-58ab8a2c123b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 200 len: 14 microversion: 2.20 time: 0.131585 Aug 27 01:35:45.057737 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 475/900] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:35:44 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:45.288577 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-17881abd-01c6-4311-a778-3f5c25aedea0 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:45.289905 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-17881abd-01c6-4311-a778-3f5c25aedea0 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 03bed1c0-44d0-4815-8f32-5a2ae2a98987] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:45.318746 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-17881abd-01c6-4311-a778-3f5c25aedea0 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:45.319450 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-17881abd-01c6-4311-a778-3f5c25aedea0 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:45.320304 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-17881abd-01c6-4311-a778-3f5c25aedea0 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:45.320930 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-17881abd-01c6-4311-a778-3f5c25aedea0 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:45.397873 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-17881abd-01c6-4311-a778-3f5c25aedea0 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:45.407006 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-17881abd-01c6-4311-a778-3f5c25aedea0 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987" status: 200 len: 1217 microversion: 2.1 time: 0.127101 Aug 27 01:35:45.408183 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 426/901] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:45 2021] GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987 => generated 1217 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:45.842210 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-83ed5bb2-112a-421f-b75b-3124303595b4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:45.843682 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-83ed5bb2-112a-421f-b75b-3124303595b4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:45.851217 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-83ed5bb2-112a-421f-b75b-3124303595b4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:45.851916 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-83ed5bb2-112a-421f-b75b-3124303595b4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:45.854219 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-83ed5bb2-112a-421f-b75b-3124303595b4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:45.855142 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-83ed5bb2-112a-421f-b75b-3124303595b4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:46.068353 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-90f86409-1a17-4f01-ba45-4433b6f7d319 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:46.069443 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-90f86409-1a17-4f01-ba45-4433b6f7d319 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:46.076224 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-90f86409-1a17-4f01-ba45-4433b6f7d319 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:46.076742 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-90f86409-1a17-4f01-ba45-4433b6f7d319 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:46.078170 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-90f86409-1a17-4f01-ba45-4433b6f7d319 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:46.078624 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-90f86409-1a17-4f01-ba45-4433b6f7d319 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:46.190778 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-90f86409-1a17-4f01-ba45-4433b6f7d319 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 200 len: 14 microversion: 2.20 time: 0.126493 Aug 27 01:35:46.198340 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 427/902] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:35:46 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:46.372612 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-83ed5bb2-112a-421f-b75b-3124303595b4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:46.385882 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-83ed5bb2-112a-421f-b75b-3124303595b4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 200 len: 1364 microversion: 2.1 time: 0.548132 Aug 27 01:35:46.387888 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 476/903] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:45 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 1364 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:46.434800 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-91925d61-cdd8-47fc-bb78-1753726c758b tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:46.438426 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-91925d61-cdd8-47fc-bb78-1753726c758b tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 03bed1c0-44d0-4815-8f32-5a2ae2a98987] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:46.448313 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-91925d61-cdd8-47fc-bb78-1753726c758b tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:46.450152 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-91925d61-cdd8-47fc-bb78-1753726c758b tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:46.450152 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-91925d61-cdd8-47fc-bb78-1753726c758b tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:46.450679 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-91925d61-cdd8-47fc-bb78-1753726c758b tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:46.538216 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-91925d61-cdd8-47fc-bb78-1753726c758b tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:46.548019 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-91925d61-cdd8-47fc-bb78-1753726c758b tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987" status: 200 len: 1273 microversion: 2.1 time: 0.121423 Aug 27 01:35:46.549065 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 428/904] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:46 2021] GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987 => generated 1273 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:46.957001 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-b1a40df9-4a5c-4ad0-b408-91d7d7d92dbc req-4c518ccf-e654-4869-8eb8-5b5a67b3fe72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4270f24-9903-4782-8633-a676243368a6", "name": "network-vif-plugged", "status": "completed", "tag": "043fb403-1255-4b2f-94a3-72fd35ade4a5"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:46.963054 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:35:46.963054 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:35:46.976100 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-b1a40df9-4a5c-4ad0-b408-91d7d7d92dbc req-4c518ccf-e654-4869-8eb8-5b5a67b3fe72 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:46.976100 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-b1a40df9-4a5c-4ad0-b408-91d7d7d92dbc req-4c518ccf-e654-4869-8eb8-5b5a67b3fe72 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:47.005441 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-b1a40df9-4a5c-4ad0-b408-91d7d7d92dbc req-4c518ccf-e654-4869-8eb8-5b5a67b3fe72 service nova] Creating event network-vif-plugged:043fb403-1255-4b2f-94a3-72fd35ade4a5 for instance e4270f24-9903-4782-8633-a676243368a6 on hv-cinder-75916 Aug 27 01:35:47.011177 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-b1a40df9-4a5c-4ad0-b408-91d7d7d92dbc req-4c518ccf-e654-4869-8eb8-5b5a67b3fe72 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058613 Aug 27 01:35:47.012435 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 477/905] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:35:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:35:47.202179 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-f59f7353-6782-4f2a-a587-a69b54f827ba tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:47.203198 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-f59f7353-6782-4f2a-a587-a69b54f827ba tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:47.209500 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f59f7353-6782-4f2a-a587-a69b54f827ba tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:47.209977 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f59f7353-6782-4f2a-a587-a69b54f827ba tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:47.210962 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f59f7353-6782-4f2a-a587-a69b54f827ba tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:47.215931 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f59f7353-6782-4f2a-a587-a69b54f827ba tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:47.318237 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-f59f7353-6782-4f2a-a587-a69b54f827ba tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 200 len: 14 microversion: 2.20 time: 0.119915 Aug 27 01:35:47.318922 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 429/906] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:35:47 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:47.407081 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-2bdd0864-b7fd-4993-b5a6-466738b24461 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:47.408538 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-2bdd0864-b7fd-4993-b5a6-466738b24461 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:47.424289 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2bdd0864-b7fd-4993-b5a6-466738b24461 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:47.428511 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2bdd0864-b7fd-4993-b5a6-466738b24461 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:47.428511 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2bdd0864-b7fd-4993-b5a6-466738b24461 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:47.428511 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2bdd0864-b7fd-4993-b5a6-466738b24461 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:47.567717 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-deb2df10-e6c2-4a1e-b209-af6a80206823 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:47.569885 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-deb2df10-e6c2-4a1e-b209-af6a80206823 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 03bed1c0-44d0-4815-8f32-5a2ae2a98987] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:47.584996 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-deb2df10-e6c2-4a1e-b209-af6a80206823 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:47.585414 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-deb2df10-e6c2-4a1e-b209-af6a80206823 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:47.589118 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-deb2df10-e6c2-4a1e-b209-af6a80206823 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:47.589832 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-deb2df10-e6c2-4a1e-b209-af6a80206823 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:47.720961 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-2bdd0864-b7fd-4993-b5a6-466738b24461 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:47.729033 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-2bdd0864-b7fd-4993-b5a6-466738b24461 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 200 len: 1364 microversion: 2.1 time: 0.327491 Aug 27 01:35:47.729599 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 478/907] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:47 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 1364 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:47.766517 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-deb2df10-e6c2-4a1e-b209-af6a80206823 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:47.775982 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-deb2df10-e6c2-4a1e-b209-af6a80206823 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987" status: 200 len: 1313 microversion: 2.1 time: 0.213290 Aug 27 01:35:47.777713 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 430/908] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:47 2021] GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:35:48.329465 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-3f5d5e3a-8c9b-473c-a53a-01102e818d64 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:48.331295 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-3f5d5e3a-8c9b-473c-a53a-01102e818d64 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:48.338582 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3f5d5e3a-8c9b-473c-a53a-01102e818d64 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:48.339294 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3f5d5e3a-8c9b-473c-a53a-01102e818d64 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:48.340465 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3f5d5e3a-8c9b-473c-a53a-01102e818d64 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:48.341902 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3f5d5e3a-8c9b-473c-a53a-01102e818d64 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:48.447174 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-3f5d5e3a-8c9b-473c-a53a-01102e818d64 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 200 len: 507 microversion: 2.20 time: 0.121516 Aug 27 01:35:48.451597 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 479/909] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:35:48 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 507 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:35:48.753451 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-cf9786c0-6ac9-4756-81b2-2c383557e1eb tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:48.754788 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-cf9786c0-6ac9-4756-81b2-2c383557e1eb tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:48.782606 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cf9786c0-6ac9-4756-81b2-2c383557e1eb tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:48.789528 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cf9786c0-6ac9-4756-81b2-2c383557e1eb tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:48.789800 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cf9786c0-6ac9-4756-81b2-2c383557e1eb tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:48.790253 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cf9786c0-6ac9-4756-81b2-2c383557e1eb tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:48.798019 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-8c491778-3ef2-4061-b512-29445f65b617 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:48.798787 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-8c491778-3ef2-4061-b512-29445f65b617 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 03bed1c0-44d0-4815-8f32-5a2ae2a98987] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:48.805328 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8c491778-3ef2-4061-b512-29445f65b617 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:48.805775 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8c491778-3ef2-4061-b512-29445f65b617 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:48.806559 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8c491778-3ef2-4061-b512-29445f65b617 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:48.806994 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8c491778-3ef2-4061-b512-29445f65b617 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:49.149477 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-cf9786c0-6ac9-4756-81b2-2c383557e1eb tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:49.152956 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-8c491778-3ef2-4061-b512-29445f65b617 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:49.161988 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-cf9786c0-6ac9-4756-81b2-2c383557e1eb tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 200 len: 1364 microversion: 2.1 time: 0.413507 Aug 27 01:35:49.165244 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 431/910] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:48 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 1364 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:49.168878 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-8c491778-3ef2-4061-b512-29445f65b617 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987" status: 200 len: 1313 microversion: 2.1 time: 0.377126 Aug 27 01:35:49.169616 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 480/911] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:48 2021] GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987 => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:49.179033 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-de0f20a4-dfa9-4ec7-8535-81d0ad618e3c req-d545d1fb-693d-4664-b8bf-28a53eff2233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03bed1c0-44d0-4815-8f32-5a2ae2a98987", "tag": "2984aa66-7f95-4011-b9e2-5845a5757cc0"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:49.179033 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:35:49.179033 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:35:49.180004 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-de0f20a4-dfa9-4ec7-8535-81d0ad618e3c req-d545d1fb-693d-4664-b8bf-28a53eff2233 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:49.180454 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-de0f20a4-dfa9-4ec7-8535-81d0ad618e3c req-d545d1fb-693d-4664-b8bf-28a53eff2233 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:49.192945 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-de0f20a4-dfa9-4ec7-8535-81d0ad618e3c req-d545d1fb-693d-4664-b8bf-28a53eff2233 service nova] Creating event network-changed:2984aa66-7f95-4011-b9e2-5845a5757cc0 for instance 03bed1c0-44d0-4815-8f32-5a2ae2a98987 on hv-cinder-75916 Aug 27 01:35:49.198159 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-de0f20a4-dfa9-4ec7-8535-81d0ad618e3c req-d545d1fb-693d-4664-b8bf-28a53eff2233 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031621 Aug 27 01:35:49.198766 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 432/912] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:35:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:35:49.465166 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4d15c740-2e30-4bdf-8c25-4722f56295a9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:49.465166 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4d15c740-2e30-4bdf-8c25-4722f56295a9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:49.466226 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4d15c740-2e30-4bdf-8c25-4722f56295a9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:49.466680 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4d15c740-2e30-4bdf-8c25-4722f56295a9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:49.467461 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4d15c740-2e30-4bdf-8c25-4722f56295a9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:49.473671 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4d15c740-2e30-4bdf-8c25-4722f56295a9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:49.579534 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4d15c740-2e30-4bdf-8c25-4722f56295a9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 200 len: 12936 microversion: 2.20 time: 0.123752 Aug 27 01:35:49.582003 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 481/913] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:35:49 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 12936 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:35:50.181103 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-d413f4a4-3193-4aa3-a62c-e12e250f3dc4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:50.181806 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-d413f4a4-3193-4aa3-a62c-e12e250f3dc4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:50.186880 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-454630ff-7606-4d07-b2f1-4780e4b775f7 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:50.188032 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-454630ff-7606-4d07-b2f1-4780e4b775f7 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 03bed1c0-44d0-4815-8f32-5a2ae2a98987] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:50.197514 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d413f4a4-3193-4aa3-a62c-e12e250f3dc4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:50.199648 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d413f4a4-3193-4aa3-a62c-e12e250f3dc4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:50.200390 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d413f4a4-3193-4aa3-a62c-e12e250f3dc4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:50.200506 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-454630ff-7606-4d07-b2f1-4780e4b775f7 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:50.200929 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-454630ff-7606-4d07-b2f1-4780e4b775f7 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:50.201722 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-454630ff-7606-4d07-b2f1-4780e4b775f7 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:50.202738 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-454630ff-7606-4d07-b2f1-4780e4b775f7 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:50.210546 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d413f4a4-3193-4aa3-a62c-e12e250f3dc4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:50.467215 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-454630ff-7606-4d07-b2f1-4780e4b775f7 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:50.482260 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-454630ff-7606-4d07-b2f1-4780e4b775f7 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987" status: 200 len: 1313 microversion: 2.1 time: 0.299455 Aug 27 01:35:50.482795 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 482/914] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:50 2021] GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987 => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:35:50.591707 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-a6e4c5d9-314a-4b30-8694-dfa2d225d917 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:50.593220 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-a6e4c5d9-314a-4b30-8694-dfa2d225d917 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:50.599217 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a6e4c5d9-314a-4b30-8694-dfa2d225d917 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:50.599659 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a6e4c5d9-314a-4b30-8694-dfa2d225d917 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:50.600411 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a6e4c5d9-314a-4b30-8694-dfa2d225d917 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:50.601040 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a6e4c5d9-314a-4b30-8694-dfa2d225d917 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:50.645242 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-d413f4a4-3193-4aa3-a62c-e12e250f3dc4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:50.655971 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-d413f4a4-3193-4aa3-a62c-e12e250f3dc4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 200 len: 1550 microversion: 2.1 time: 0.478782 Aug 27 01:35:50.657913 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 433/915] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:50 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 1550 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:50.685414 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-b78930d6-659a-458d-8083-0dd6f10cd384 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:50.685414 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-b78930d6-659a-458d-8083-0dd6f10cd384 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:50.691691 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b78930d6-659a-458d-8083-0dd6f10cd384 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:50.692202 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b78930d6-659a-458d-8083-0dd6f10cd384 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:50.693812 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b78930d6-659a-458d-8083-0dd6f10cd384 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:50.694862 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b78930d6-659a-458d-8083-0dd6f10cd384 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:50.725384 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-a6e4c5d9-314a-4b30-8694-dfa2d225d917 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 200 len: 18449 microversion: 2.20 time: 0.137215 Aug 27 01:35:50.726172 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 483/916] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:35:50 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 18449 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 01:35:50.798099 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-b78930d6-659a-458d-8083-0dd6f10cd384 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119792 Aug 27 01:35:50.798688 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 434/917] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Aug 27 01:35:50 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:35:51.502222 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-0973a564-4fad-4e98-9112-e4d48ddeb44e tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:51.503086 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-0973a564-4fad-4e98-9112-e4d48ddeb44e tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 03bed1c0-44d0-4815-8f32-5a2ae2a98987] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:51.510469 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0973a564-4fad-4e98-9112-e4d48ddeb44e tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:51.511163 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0973a564-4fad-4e98-9112-e4d48ddeb44e tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:51.512317 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0973a564-4fad-4e98-9112-e4d48ddeb44e tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:51.513101 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0973a564-4fad-4e98-9112-e4d48ddeb44e tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:51.738733 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-4758a6fb-85dc-4548-aac4-b50a9c929ce6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:51.740224 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-4758a6fb-85dc-4548-aac4-b50a9c929ce6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:51.747305 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4758a6fb-85dc-4548-aac4-b50a9c929ce6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:51.748017 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4758a6fb-85dc-4548-aac4-b50a9c929ce6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:51.749756 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4758a6fb-85dc-4548-aac4-b50a9c929ce6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:51.750526 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4758a6fb-85dc-4548-aac4-b50a9c929ce6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:51.862806 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-4758a6fb-85dc-4548-aac4-b50a9c929ce6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 200 len: 19342 microversion: 2.20 time: 0.128972 Aug 27 01:35:51.863812 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 435/918] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:35:51 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 19342 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 01:35:51.873164 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-0973a564-4fad-4e98-9112-e4d48ddeb44e tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:51.884218 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-0973a564-4fad-4e98-9112-e4d48ddeb44e tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987" status: 200 len: 1313 microversion: 2.1 time: 0.388346 Aug 27 01:35:51.885400 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 484/919] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:51 2021] GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987 => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:52.270728 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-e2d7d973-fa6b-436a-a639-b7ff0684994c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:52.272372 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-e2d7d973-fa6b-436a-a639-b7ff0684994c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:52.280920 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e2d7d973-fa6b-436a-a639-b7ff0684994c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:52.283215 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e2d7d973-fa6b-436a-a639-b7ff0684994c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:52.284747 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e2d7d973-fa6b-436a-a639-b7ff0684994c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:52.286146 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e2d7d973-fa6b-436a-a639-b7ff0684994c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:52.293905 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-be5731f5-1cd6-431c-8396-17981f700a5c req-b9d16bea-9fe1-4e7f-af3f-dd9bab663c53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4270f24-9903-4782-8633-a676243368a6", "tag": "043fb403-1255-4b2f-94a3-72fd35ade4a5"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:52.295389 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:35:52.295389 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:35:52.307096 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-be5731f5-1cd6-431c-8396-17981f700a5c req-b9d16bea-9fe1-4e7f-af3f-dd9bab663c53 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:52.307531 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-be5731f5-1cd6-431c-8396-17981f700a5c req-b9d16bea-9fe1-4e7f-af3f-dd9bab663c53 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:52.343327 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-be5731f5-1cd6-431c-8396-17981f700a5c req-b9d16bea-9fe1-4e7f-af3f-dd9bab663c53 service nova] Creating event network-changed:043fb403-1255-4b2f-94a3-72fd35ade4a5 for instance e4270f24-9903-4782-8633-a676243368a6 on hv-cinder-75916 Aug 27 01:35:52.355860 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-be5731f5-1cd6-431c-8396-17981f700a5c req-b9d16bea-9fe1-4e7f-af3f-dd9bab663c53 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065552 Aug 27 01:35:52.360972 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 485/920] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:35:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:35:52.439703 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-e2d7d973-fa6b-436a-a639-b7ff0684994c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 14 microversion: 2.1 time: 0.173811 Aug 27 01:35:52.440333 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 436/921] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:35:52 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 14 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 01:35:52.876366 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-0d30db4b-1881-4d2f-bea9-25a441ff190f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:52.879250 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-0d30db4b-1881-4d2f-bea9-25a441ff190f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:52.902350 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-4adb3381-1925-4cde-9b9f-9b891a920090 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:52.904482 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-4adb3381-1925-4cde-9b9f-9b891a920090 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 03bed1c0-44d0-4815-8f32-5a2ae2a98987] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:52.911477 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0d30db4b-1881-4d2f-bea9-25a441ff190f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:52.912192 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0d30db4b-1881-4d2f-bea9-25a441ff190f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:52.914781 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4adb3381-1925-4cde-9b9f-9b891a920090 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:52.915507 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4adb3381-1925-4cde-9b9f-9b891a920090 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:52.916599 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4adb3381-1925-4cde-9b9f-9b891a920090 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:52.917084 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0d30db4b-1881-4d2f-bea9-25a441ff190f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:52.917561 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0d30db4b-1881-4d2f-bea9-25a441ff190f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:52.917676 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4adb3381-1925-4cde-9b9f-9b891a920090 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:53.059756 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-0d30db4b-1881-4d2f-bea9-25a441ff190f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 200 len: 22064 microversion: 2.20 time: 0.187985 Aug 27 01:35:53.062641 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 486/922] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:35:52 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 22064 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:35:53.167831 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-4adb3381-1925-4cde-9b9f-9b891a920090 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:53.186125 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-4adb3381-1925-4cde-9b9f-9b891a920090 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987" status: 200 len: 1313 microversion: 2.1 time: 0.288461 Aug 27 01:35:53.187396 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 437/923] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:52 2021] GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987 => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:53.456227 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-3e76b6a9-c45e-4c80-84c5-c60950f69b6a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:53.459268 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-3e76b6a9-c45e-4c80-84c5-c60950f69b6a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:53.467342 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3e76b6a9-c45e-4c80-84c5-c60950f69b6a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:53.477870 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3e76b6a9-c45e-4c80-84c5-c60950f69b6a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:53.477870 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3e76b6a9-c45e-4c80-84c5-c60950f69b6a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:53.477870 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3e76b6a9-c45e-4c80-84c5-c60950f69b6a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:53.593320 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-3e76b6a9-c45e-4c80-84c5-c60950f69b6a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 14 microversion: 2.1 time: 0.144488 Aug 27 01:35:53.596607 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 487/924] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:35:53 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 01:35:54.073890 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-55abf1a5-78ca-4431-8d4c-457b70f48022 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:54.074910 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-55abf1a5-78ca-4431-8d4c-457b70f48022 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:54.083992 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-55abf1a5-78ca-4431-8d4c-457b70f48022 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:54.084732 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-55abf1a5-78ca-4431-8d4c-457b70f48022 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:54.086687 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-55abf1a5-78ca-4431-8d4c-457b70f48022 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:54.087311 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-55abf1a5-78ca-4431-8d4c-457b70f48022 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:54.208517 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-3e4c7f41-d02c-489a-bb43-09e89d2cdf6a tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:54.215508 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-3e4c7f41-d02c-489a-bb43-09e89d2cdf6a tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 03bed1c0-44d0-4815-8f32-5a2ae2a98987] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:54.215910 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-55abf1a5-78ca-4431-8d4c-457b70f48022 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 200 len: 23229 microversion: 2.20 time: 0.140602 Aug 27 01:35:54.215910 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 438/925] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:35:54 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 23229 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:35:54.221243 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3e4c7f41-d02c-489a-bb43-09e89d2cdf6a tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:54.221710 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3e4c7f41-d02c-489a-bb43-09e89d2cdf6a tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:54.222493 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3e4c7f41-d02c-489a-bb43-09e89d2cdf6a tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:54.222939 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3e4c7f41-d02c-489a-bb43-09e89d2cdf6a tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:54.427994 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-3e4c7f41-d02c-489a-bb43-09e89d2cdf6a tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:54.440481 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-3e4c7f41-d02c-489a-bb43-09e89d2cdf6a tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987" status: 200 len: 1313 microversion: 2.1 time: 0.237522 Aug 27 01:35:54.443305 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 488/926] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:54 2021] GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:35:54.604021 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-0dd37cc6-c572-4de2-8739-ba49b6807f03 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:54.605069 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-0dd37cc6-c572-4de2-8739-ba49b6807f03 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:54.612149 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0dd37cc6-c572-4de2-8739-ba49b6807f03 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:54.612601 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0dd37cc6-c572-4de2-8739-ba49b6807f03 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:54.613414 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0dd37cc6-c572-4de2-8739-ba49b6807f03 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:54.613844 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0dd37cc6-c572-4de2-8739-ba49b6807f03 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:54.723271 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-0dd37cc6-c572-4de2-8739-ba49b6807f03 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 14 microversion: 2.1 time: 0.123132 Aug 27 01:35:54.723958 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 439/927] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:35:54 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 01:35:55.225259 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-10eeb430-83ea-4b88-809e-4a2fbb1b85e4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:55.226159 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-10eeb430-83ea-4b88-809e-4a2fbb1b85e4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:55.232394 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-10eeb430-83ea-4b88-809e-4a2fbb1b85e4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:55.232882 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-10eeb430-83ea-4b88-809e-4a2fbb1b85e4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:55.234288 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-10eeb430-83ea-4b88-809e-4a2fbb1b85e4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:55.234805 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-10eeb430-83ea-4b88-809e-4a2fbb1b85e4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:55.324946 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-10eeb430-83ea-4b88-809e-4a2fbb1b85e4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 200 len: 24669 microversion: 2.20 time: 0.103026 Aug 27 01:35:55.325558 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 489/928] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:35:55 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 24669 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:35:55.459824 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c920d5dd-7b7d-4ffa-8047-b8774d5ef2c6 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:55.460525 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c920d5dd-7b7d-4ffa-8047-b8774d5ef2c6 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 03bed1c0-44d0-4815-8f32-5a2ae2a98987] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:55.466834 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c920d5dd-7b7d-4ffa-8047-b8774d5ef2c6 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:55.467259 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c920d5dd-7b7d-4ffa-8047-b8774d5ef2c6 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:55.468699 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c920d5dd-7b7d-4ffa-8047-b8774d5ef2c6 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:55.469201 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c920d5dd-7b7d-4ffa-8047-b8774d5ef2c6 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:55.594159 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c920d5dd-7b7d-4ffa-8047-b8774d5ef2c6 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:55.601896 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c920d5dd-7b7d-4ffa-8047-b8774d5ef2c6 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987" status: 200 len: 1313 microversion: 2.1 time: 0.146241 Aug 27 01:35:55.602450 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 440/929] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:55 2021] GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:55.735231 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-293d2d21-b534-4037-9348-9bda618ba1ab tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:55.736293 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-293d2d21-b534-4037-9348-9bda618ba1ab tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:55.742800 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-293d2d21-b534-4037-9348-9bda618ba1ab tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:55.743238 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-293d2d21-b534-4037-9348-9bda618ba1ab tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:55.743997 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-293d2d21-b534-4037-9348-9bda618ba1ab tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:55.744451 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-293d2d21-b534-4037-9348-9bda618ba1ab tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:55.835443 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-293d2d21-b534-4037-9348-9bda618ba1ab tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 14 microversion: 2.1 time: 0.104261 Aug 27 01:35:55.838508 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 490/930] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:35:55 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 01:35:56.336752 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-72db4291-3e41-4efe-8880-2b83af59301e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:56.338009 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-72db4291-3e41-4efe-8880-2b83af59301e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:56.346642 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-72db4291-3e41-4efe-8880-2b83af59301e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:56.347001 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-72db4291-3e41-4efe-8880-2b83af59301e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:56.347782 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-72db4291-3e41-4efe-8880-2b83af59301e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:56.352442 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-72db4291-3e41-4efe-8880-2b83af59301e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:56.466858 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-72db4291-3e41-4efe-8880-2b83af59301e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 200 len: 26331 microversion: 2.20 time: 0.133740 Aug 27 01:35:56.468351 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 441/931] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:35:56 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 26331 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:35:56.619364 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-fe17513f-6c1d-4acf-a14f-92f616883024 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:56.620636 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-fe17513f-6c1d-4acf-a14f-92f616883024 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 03bed1c0-44d0-4815-8f32-5a2ae2a98987] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:56.628037 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fe17513f-6c1d-4acf-a14f-92f616883024 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:56.628725 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fe17513f-6c1d-4acf-a14f-92f616883024 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:56.629678 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fe17513f-6c1d-4acf-a14f-92f616883024 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:56.630262 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fe17513f-6c1d-4acf-a14f-92f616883024 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:56.823560 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-fe17513f-6c1d-4acf-a14f-92f616883024 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:56.838508 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-fe17513f-6c1d-4acf-a14f-92f616883024 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987" status: 200 len: 1313 microversion: 2.1 time: 0.222949 Aug 27 01:35:56.839114 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 491/932] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:56 2021] GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:56.854303 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-8ad2f971-2d02-485a-be33-3b2048906cfe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:56.855682 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-8ad2f971-2d02-485a-be33-3b2048906cfe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:56.866993 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8ad2f971-2d02-485a-be33-3b2048906cfe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:56.867450 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8ad2f971-2d02-485a-be33-3b2048906cfe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:56.868453 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8ad2f971-2d02-485a-be33-3b2048906cfe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:56.869882 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8ad2f971-2d02-485a-be33-3b2048906cfe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:57.010041 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-8ad2f971-2d02-485a-be33-3b2048906cfe tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 14 microversion: 2.1 time: 0.161786 Aug 27 01:35:57.011419 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 442/933] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:35:56 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 01:35:57.080411 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-80b591d1-1bad-4f6c-8a0d-464971ed057b req-43789196-e35d-48ef-8384-f74c9ab0c643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03bed1c0-44d0-4815-8f32-5a2ae2a98987", "name": "network-vif-plugged", "status": "completed", "tag": "2984aa66-7f95-4011-b9e2-5845a5757cc0"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:57.081968 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:35:57.081968 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:35:57.094031 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-80b591d1-1bad-4f6c-8a0d-464971ed057b req-43789196-e35d-48ef-8384-f74c9ab0c643 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:57.094733 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-80b591d1-1bad-4f6c-8a0d-464971ed057b req-43789196-e35d-48ef-8384-f74c9ab0c643 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:57.106816 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-80b591d1-1bad-4f6c-8a0d-464971ed057b req-43789196-e35d-48ef-8384-f74c9ab0c643 service nova] Creating event network-vif-plugged:2984aa66-7f95-4011-b9e2-5845a5757cc0 for instance 03bed1c0-44d0-4815-8f32-5a2ae2a98987 on hv-cinder-75916 Aug 27 01:35:57.119489 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-80b591d1-1bad-4f6c-8a0d-464971ed057b req-43789196-e35d-48ef-8384-f74c9ab0c643 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043246 Aug 27 01:35:57.120668 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 492/934] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:35:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:35:57.480286 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-9a0d082d-a623-4ffd-946f-995bba693ed6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:57.481507 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-9a0d082d-a623-4ffd-946f-995bba693ed6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:57.504700 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9a0d082d-a623-4ffd-946f-995bba693ed6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:57.509364 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9a0d082d-a623-4ffd-946f-995bba693ed6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:57.510470 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9a0d082d-a623-4ffd-946f-995bba693ed6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:57.512235 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9a0d082d-a623-4ffd-946f-995bba693ed6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:57.863862 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-5b44ebcb-8657-4e46-970b-f7c57cf553db tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:57.864691 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-5b44ebcb-8657-4e46-970b-f7c57cf553db tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 03bed1c0-44d0-4815-8f32-5a2ae2a98987] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:57.871456 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5b44ebcb-8657-4e46-970b-f7c57cf553db tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:57.872014 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5b44ebcb-8657-4e46-970b-f7c57cf553db tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:57.872893 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5b44ebcb-8657-4e46-970b-f7c57cf553db tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:57.873400 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5b44ebcb-8657-4e46-970b-f7c57cf553db tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:57.908804 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-9a0d082d-a623-4ffd-946f-995bba693ed6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 200 len: 27543 microversion: 2.20 time: 0.433499 Aug 27 01:35:57.910425 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 443/935] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:35:57 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 27543 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:35:58.022130 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-90aa43f6-afd7-4b07-a66b-ead560e885d6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:58.025722 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-90aa43f6-afd7-4b07-a66b-ead560e885d6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:58.034287 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-90aa43f6-afd7-4b07-a66b-ead560e885d6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:58.035167 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-90aa43f6-afd7-4b07-a66b-ead560e885d6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:58.036153 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-90aa43f6-afd7-4b07-a66b-ead560e885d6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:58.036763 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-90aa43f6-afd7-4b07-a66b-ead560e885d6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:58.147922 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-90aa43f6-afd7-4b07-a66b-ead560e885d6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 14 microversion: 2.1 time: 0.129638 Aug 27 01:35:58.148977 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 444/936] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:35:58 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 01:35:58.331736 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-5b44ebcb-8657-4e46-970b-f7c57cf553db tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:58.340980 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-5b44ebcb-8657-4e46-970b-f7c57cf553db tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987" status: 200 len: 1313 microversion: 2.1 time: 0.481149 Aug 27 01:35:58.342075 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 493/937] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:57 2021] GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987 => generated 1313 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:35:58.921679 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-e4ffdceb-c29d-4d6f-bdfd-074cefe47e01 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:58.922705 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-e4ffdceb-c29d-4d6f-bdfd-074cefe47e01 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:58.929806 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e4ffdceb-c29d-4d6f-bdfd-074cefe47e01 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:58.930507 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e4ffdceb-c29d-4d6f-bdfd-074cefe47e01 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:58.931422 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e4ffdceb-c29d-4d6f-bdfd-074cefe47e01 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:58.932008 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e4ffdceb-c29d-4d6f-bdfd-074cefe47e01 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:59.034545 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-e4ffdceb-c29d-4d6f-bdfd-074cefe47e01 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 200 len: 27893 microversion: 2.20 time: 0.117675 Aug 27 01:35:59.035206 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 445/938] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:35:58 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 27893 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:35:59.159794 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-1f3c12e8-4884-434c-a43d-ecfed15502b6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:35:59.160807 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-1f3c12e8-4884-434c-a43d-ecfed15502b6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:59.204563 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1f3c12e8-4884-434c-a43d-ecfed15502b6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:59.204563 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1f3c12e8-4884-434c-a43d-ecfed15502b6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:59.204563 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1f3c12e8-4884-434c-a43d-ecfed15502b6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:59.204563 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1f3c12e8-4884-434c-a43d-ecfed15502b6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:59.251504 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-1f3c12e8-4884-434c-a43d-ecfed15502b6 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 14 microversion: 2.1 time: 0.095217 Aug 27 01:35:59.252180 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 494/939] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:35:59 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 01:35:59.359131 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c042c476-1208-48e0-b8f1-a6dadecad323 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:35:59.360303 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c042c476-1208-48e0-b8f1-a6dadecad323 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 03bed1c0-44d0-4815-8f32-5a2ae2a98987] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:35:59.367622 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c042c476-1208-48e0-b8f1-a6dadecad323 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:59.368146 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c042c476-1208-48e0-b8f1-a6dadecad323 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:59.372671 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c042c476-1208-48e0-b8f1-a6dadecad323 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:35:59.372671 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c042c476-1208-48e0-b8f1-a6dadecad323 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:35:59.546082 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c042c476-1208-48e0-b8f1-a6dadecad323 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:35:59.554815 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c042c476-1208-48e0-b8f1-a6dadecad323 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987" status: 200 len: 1496 microversion: 2.1 time: 0.199772 Aug 27 01:35:59.555369 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 446/940] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:35:59 2021] GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987 => generated 1496 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:36:00.047704 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-a1770802-76ba-419a-bdfb-799e8093156a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:00.048768 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-a1770802-76ba-419a-bdfb-799e8093156a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:00.060736 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a1770802-76ba-419a-bdfb-799e8093156a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:00.061817 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a1770802-76ba-419a-bdfb-799e8093156a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:00.064456 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a1770802-76ba-419a-bdfb-799e8093156a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:00.065171 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a1770802-76ba-419a-bdfb-799e8093156a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:00.183373 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-a1770802-76ba-419a-bdfb-799e8093156a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 200 len: 28147 microversion: 2.20 time: 0.140128 Aug 27 01:36:00.184004 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 495/941] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:36:00 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 28147 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:36:00.262566 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-fabbeefe-1342-4d6d-8510-c0d1ba8c4400 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:00.264883 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-fabbeefe-1342-4d6d-8510-c0d1ba8c4400 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:00.272008 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fabbeefe-1342-4d6d-8510-c0d1ba8c4400 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:00.272683 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fabbeefe-1342-4d6d-8510-c0d1ba8c4400 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:00.274095 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fabbeefe-1342-4d6d-8510-c0d1ba8c4400 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:00.274758 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fabbeefe-1342-4d6d-8510-c0d1ba8c4400 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:00.381464 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-fabbeefe-1342-4d6d-8510-c0d1ba8c4400 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 14 microversion: 2.1 time: 0.121721 Aug 27 01:36:00.382551 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 447/942] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:36:00 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 01:36:00.645930 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-516937d0-7f07-4922-bc9f-32afaacde477 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:00.645930 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-516937d0-7f07-4922-bc9f-32afaacde477 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 03bed1c0-44d0-4815-8f32-5a2ae2a98987] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:00.649367 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-516937d0-7f07-4922-bc9f-32afaacde477 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:00.650028 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-516937d0-7f07-4922-bc9f-32afaacde477 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:00.651050 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-516937d0-7f07-4922-bc9f-32afaacde477 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:00.651486 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-516937d0-7f07-4922-bc9f-32afaacde477 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:00.689768 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-516937d0-7f07-4922-bc9f-32afaacde477 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 03bed1c0-44d0-4815-8f32-5a2ae2a98987] Going to try to terminate instance {{(pid=108755) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 01:36:01.026098 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-516937d0-7f07-4922-bc9f-32afaacde477 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "DELETE /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987" status: 204 len: 0 microversion: 2.1 time: 0.388929 Aug 27 01:36:01.026883 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 496/943] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Aug 27 01:36:00 2021] DELETE /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 01:36:01.038434 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-8f6ddbf5-29ff-4397-8491-2dfa05ccb59f tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:01.039498 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-8f6ddbf5-29ff-4397-8491-2dfa05ccb59f tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 03bed1c0-44d0-4815-8f32-5a2ae2a98987] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:01.046616 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8f6ddbf5-29ff-4397-8491-2dfa05ccb59f tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:01.047323 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8f6ddbf5-29ff-4397-8491-2dfa05ccb59f tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:01.049212 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8f6ddbf5-29ff-4397-8491-2dfa05ccb59f tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:01.050483 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8f6ddbf5-29ff-4397-8491-2dfa05ccb59f tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:01.193515 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-8f6ddbf5-29ff-4397-8491-2dfa05ccb59f tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:01.201282 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-7f065031-4fd2-4c87-93bf-46149e33799d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:01.202561 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-7f065031-4fd2-4c87-93bf-46149e33799d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:01.203734 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-8f6ddbf5-29ff-4397-8491-2dfa05ccb59f tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987" status: 200 len: 1502 microversion: 2.1 time: 0.171729 Aug 27 01:36:01.204942 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 448/944] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:01 2021] GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987 => generated 1502 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:36:01.219348 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7f065031-4fd2-4c87-93bf-46149e33799d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:01.219887 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7f065031-4fd2-4c87-93bf-46149e33799d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:01.220716 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7f065031-4fd2-4c87-93bf-46149e33799d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:01.221173 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7f065031-4fd2-4c87-93bf-46149e33799d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:01.314253 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-7f065031-4fd2-4c87-93bf-46149e33799d tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 200 len: 28147 microversion: 2.20 time: 0.121901 Aug 27 01:36:01.315161 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 497/945] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:36:01 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 28147 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 01:36:01.395009 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-a53452cb-dd1b-465e-bc1e-22d97903289c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:01.396763 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-a53452cb-dd1b-465e-bc1e-22d97903289c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:01.403196 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a53452cb-dd1b-465e-bc1e-22d97903289c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:01.403755 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a53452cb-dd1b-465e-bc1e-22d97903289c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:01.405614 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a53452cb-dd1b-465e-bc1e-22d97903289c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:01.406489 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a53452cb-dd1b-465e-bc1e-22d97903289c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:01.506717 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-a53452cb-dd1b-465e-bc1e-22d97903289c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 14 microversion: 2.1 time: 0.117852 Aug 27 01:36:01.508065 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 449/946] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:36:01 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 01:36:02.226885 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-6b949580-13ed-4f20-9963-b49106ad1688 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:02.227598 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-6b949580-13ed-4f20-9963-b49106ad1688 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 03bed1c0-44d0-4815-8f32-5a2ae2a98987] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:02.235551 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6b949580-13ed-4f20-9963-b49106ad1688 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:02.236025 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6b949580-13ed-4f20-9963-b49106ad1688 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:02.237457 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6b949580-13ed-4f20-9963-b49106ad1688 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:02.237457 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6b949580-13ed-4f20-9963-b49106ad1688 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:02.328975 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-6bf0087b-ca95-4ead-8496-644d21f694f1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:02.330280 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-6bf0087b-ca95-4ead-8496-644d21f694f1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:02.338521 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6bf0087b-ca95-4ead-8496-644d21f694f1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:02.339383 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6bf0087b-ca95-4ead-8496-644d21f694f1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:02.340179 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6bf0087b-ca95-4ead-8496-644d21f694f1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:02.340643 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6bf0087b-ca95-4ead-8496-644d21f694f1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:02.376851 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-6b949580-13ed-4f20-9963-b49106ad1688 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:02.384216 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-6b949580-13ed-4f20-9963-b49106ad1688 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987" status: 200 len: 1502 microversion: 2.1 time: 0.161431 Aug 27 01:36:02.384764 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 498/947] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:02 2021] GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987 => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:36:02.469927 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-6bf0087b-ca95-4ead-8496-644d21f694f1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 200 len: 28438 microversion: 2.20 time: 0.146080 Aug 27 01:36:02.470648 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 450/948] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:36:02 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 28438 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 01:36:02.518592 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-30cdcc73-ad5e-480a-bb66-4da9b18ef364 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:02.519654 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-30cdcc73-ad5e-480a-bb66-4da9b18ef364 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:02.526080 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-30cdcc73-ad5e-480a-bb66-4da9b18ef364 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:02.526528 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-30cdcc73-ad5e-480a-bb66-4da9b18ef364 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:02.527303 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-30cdcc73-ad5e-480a-bb66-4da9b18ef364 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:02.527802 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-30cdcc73-ad5e-480a-bb66-4da9b18ef364 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:02.631266 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-30cdcc73-ad5e-480a-bb66-4da9b18ef364 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 10009 microversion: 2.1 time: 0.117013 Aug 27 01:36:02.631893 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 499/949] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:36:02 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 10009 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:36:03.403509 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-02ff3c73-bc4a-4d46-970c-e759ddfe3e03 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:03.405348 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-02ff3c73-bc4a-4d46-970c-e759ddfe3e03 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 03bed1c0-44d0-4815-8f32-5a2ae2a98987] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:03.415460 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-02ff3c73-bc4a-4d46-970c-e759ddfe3e03 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:03.416308 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-02ff3c73-bc4a-4d46-970c-e759ddfe3e03 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:03.417275 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-02ff3c73-bc4a-4d46-970c-e759ddfe3e03 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:03.417874 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-02ff3c73-bc4a-4d46-970c-e759ddfe3e03 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:03.459968 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-7854aabc-649b-4e42-84b7-baab18d40e27 req-6ee781b6-4ecb-43c1-834a-469b1b1fd0bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03bed1c0-44d0-4815-8f32-5a2ae2a98987", "name": "network-vif-deleted", "tag": "2984aa66-7f95-4011-b9e2-5845a5757cc0"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:03.460903 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:36:03.460903 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:36:03.470640 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-7854aabc-649b-4e42-84b7-baab18d40e27 req-6ee781b6-4ecb-43c1-834a-469b1b1fd0bf service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:03.471402 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-7854aabc-649b-4e42-84b7-baab18d40e27 req-6ee781b6-4ecb-43c1-834a-469b1b1fd0bf service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:03.487397 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-7854aabc-649b-4e42-84b7-baab18d40e27 req-6ee781b6-4ecb-43c1-834a-469b1b1fd0bf service nova] Creating event network-vif-deleted:2984aa66-7f95-4011-b9e2-5845a5757cc0 for instance 03bed1c0-44d0-4815-8f32-5a2ae2a98987 on hv-cinder-75916 Aug 27 01:36:03.492548 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-02ff3c73-bc4a-4d46-970c-e759ddfe3e03 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:03.493563 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-7854aabc-649b-4e42-84b7-baab18d40e27 req-6ee781b6-4ecb-43c1-834a-469b1b1fd0bf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038099 Aug 27 01:36:03.494612 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 500/950] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:36:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:36:03.501827 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-02ff3c73-bc4a-4d46-970c-e759ddfe3e03 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987" status: 200 len: 1460 microversion: 2.1 time: 0.104286 Aug 27 01:36:03.512672 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 451/951] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:03 2021] GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987 => generated 1460 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:36:03.512783 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-f19df919-69e6-4f55-a774-c822a79fda7a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:03.512783 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-f19df919-69e6-4f55-a774-c822a79fda7a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:03.520530 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f19df919-69e6-4f55-a774-c822a79fda7a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:03.521483 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f19df919-69e6-4f55-a774-c822a79fda7a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:03.522258 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f19df919-69e6-4f55-a774-c822a79fda7a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:03.522691 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f19df919-69e6-4f55-a774-c822a79fda7a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:03.643290 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-5969df56-4da0-4148-bbd6-5bd95008ced8 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:03.644201 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-5969df56-4da0-4148-bbd6-5bd95008ced8 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:03.645929 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-f19df919-69e6-4f55-a774-c822a79fda7a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 200 len: 28606 microversion: 2.20 time: 0.134252 Aug 27 01:36:03.646640 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 501/952] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:36:03 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 28606 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:36:03.656945 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5969df56-4da0-4148-bbd6-5bd95008ced8 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:03.657399 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5969df56-4da0-4148-bbd6-5bd95008ced8 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:03.658170 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5969df56-4da0-4148-bbd6-5bd95008ced8 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:03.658777 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5969df56-4da0-4148-bbd6-5bd95008ced8 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:03.767387 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-5969df56-4da0-4148-bbd6-5bd95008ced8 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 17354 microversion: 2.1 time: 0.127734 Aug 27 01:36:03.771013 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 452/953] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:36:03 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 17354 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:36:04.519717 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-93de3e1d-9634-4ed3-bea3-7d91cfa7988d tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:04.520323 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-93de3e1d-9634-4ed3-bea3-7d91cfa7988d tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 03bed1c0-44d0-4815-8f32-5a2ae2a98987] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:04.527000 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-93de3e1d-9634-4ed3-bea3-7d91cfa7988d tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:04.527668 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-93de3e1d-9634-4ed3-bea3-7d91cfa7988d tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:04.529057 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-93de3e1d-9634-4ed3-bea3-7d91cfa7988d tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:04.530318 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-93de3e1d-9634-4ed3-bea3-7d91cfa7988d tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:04.552988 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.wsgi [None req-93de3e1d-9634-4ed3-bea3-7d91cfa7988d tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] HTTP exception thrown: Instance 03bed1c0-44d0-4815-8f32-5a2ae2a98987 could not be found. Aug 27 01:36:04.553616 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-93de3e1d-9634-4ed3-bea3-7d91cfa7988d tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Returning 404 to user: Instance 03bed1c0-44d0-4815-8f32-5a2ae2a98987 could not be found. {{(pid=108755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:36:04.554581 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-93de3e1d-9634-4ed3-bea3-7d91cfa7988d tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987" status: 404 len: 111 microversion: 2.1 time: 0.038916 Aug 27 01:36:04.557198 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 502/954] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:04 2021] GET /compute/v2.1/servers/03bed1c0-44d0-4815-8f32-5a2ae2a98987 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:36:04.658300 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-7ff1aba8-47c6-4e2d-8f50-e1145eb9e2f3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:04.659298 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-7ff1aba8-47c6-4e2d-8f50-e1145eb9e2f3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:04.665918 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7ff1aba8-47c6-4e2d-8f50-e1145eb9e2f3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:04.666362 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7ff1aba8-47c6-4e2d-8f50-e1145eb9e2f3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:04.667133 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7ff1aba8-47c6-4e2d-8f50-e1145eb9e2f3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:04.667558 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7ff1aba8-47c6-4e2d-8f50-e1145eb9e2f3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:04.673902 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d16e71d6-29f2-4970-9c51-3a79c0c264bd tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1998402417", "imageRef": "6660bea6-dee9-43b4-95ef-29b53e1a2b28", "flavorRef": "452", "networks": [{"uuid": "0788b1ad-cd04-4b18-949e-72f4f8f536f9"}]}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:04.728330 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.network.neutron [None req-d16e71d6-29f2-4970-9c51-3a79c0c264bd tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] validate_networks() for [('0788b1ad-cd04-4b18-949e-72f4f8f536f9', None, None, None, None, None)] {{(pid=108755) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 01:36:04.758776 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-7ff1aba8-47c6-4e2d-8f50-e1145eb9e2f3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 200 len: 28606 microversion: 2.20 time: 0.104668 Aug 27 01:36:04.760322 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 453/955] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:36:04 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 28606 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:36:04.779622 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c54a8af3-c0cc-490a-9253-a15fe296c7f2 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:04.782739 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c54a8af3-c0cc-490a-9253-a15fe296c7f2 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:04.794523 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c54a8af3-c0cc-490a-9253-a15fe296c7f2 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:04.795237 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c54a8af3-c0cc-490a-9253-a15fe296c7f2 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:04.797883 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c54a8af3-c0cc-490a-9253-a15fe296c7f2 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:04.798587 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c54a8af3-c0cc-490a-9253-a15fe296c7f2 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:04.890923 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c54a8af3-c0cc-490a-9253-a15fe296c7f2 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 18305 microversion: 2.1 time: 0.115288 Aug 27 01:36:04.891576 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 454/956] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:36:04 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 18305 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:36:05.226958 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.virt.hardware [None req-d16e71d6-29f2-4970-9c51-3a79c0c264bd tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Flavor limits 0:0:0 {{(pid=108755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 01:36:05.227403 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.virt.hardware [None req-d16e71d6-29f2-4970-9c51-3a79c0c264bd tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Image limits 0:0:0 {{(pid=108755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 01:36:05.227867 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.virt.hardware [None req-d16e71d6-29f2-4970-9c51-3a79c0c264bd tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Flavor pref 0:0:0 {{(pid=108755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 01:36:05.228269 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.virt.hardware [None req-d16e71d6-29f2-4970-9c51-3a79c0c264bd tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Image pref 0:0:0 {{(pid=108755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 01:36:05.228673 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.virt.hardware [None req-d16e71d6-29f2-4970-9c51-3a79c0c264bd tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108755) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 01:36:05.239012 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d16e71d6-29f2-4970-9c51-3a79c0c264bd tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:05.239843 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d16e71d6-29f2-4970-9c51-3a79c0c264bd tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:05.240815 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d16e71d6-29f2-4970-9c51-3a79c0c264bd tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:05.241303 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d16e71d6-29f2-4970-9c51-3a79c0c264bd tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:05.258677 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-d16e71d6-29f2-4970-9c51-3a79c0c264bd tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Getting quotas for project 31b47b7bf2ed4568af16eb7861b78453. Resources: {'ram', 'instances', 'cores'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:36:05.264770 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-d16e71d6-29f2-4970-9c51-3a79c0c264bd tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Getting quotas for user b2a94d8d27de4c9db7b8f2b1285058ac and project 31b47b7bf2ed4568af16eb7861b78453. Resources: {'ram', 'instances', 'cores'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:36:05.276300 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d16e71d6-29f2-4970-9c51-3a79c0c264bd tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Going to run 1 instances... {{(pid=108755) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 01:36:05.278707 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d16e71d6-29f2-4970-9c51-3a79c0c264bd tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 8d6b5fb0-fd9d-41f2-ae08-3321565c5f39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6660bea6-dee9-43b4-95ef-29b53e1a2b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108755) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 01:36:05.440611 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d16e71d6-29f2-4970-9c51-3a79c0c264bd tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.771233 Aug 27 01:36:05.446669 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 503/957] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Aug 27 01:36:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 01:36:05.453882 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-d82bcb82-6299-4b23-b540-2094d4fef9a7 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:05.454632 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-d82bcb82-6299-4b23-b540-2094d4fef9a7 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 8d6b5fb0-fd9d-41f2-ae08-3321565c5f39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:05.510830 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-d82bcb82-6299-4b23-b540-2094d4fef9a7 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:05.518359 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-d82bcb82-6299-4b23-b540-2094d4fef9a7 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39" status: 200 len: 1214 microversion: 2.1 time: 0.069918 Aug 27 01:36:05.519072 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 455/958] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:05 2021] GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:36:05.781678 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-dbee1a5d-4a1e-496e-98f5-038837d033ad tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:05.782737 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-dbee1a5d-4a1e-496e-98f5-038837d033ad tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:05.789339 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-dbee1a5d-4a1e-496e-98f5-038837d033ad tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:05.789787 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-dbee1a5d-4a1e-496e-98f5-038837d033ad tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:05.790555 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-dbee1a5d-4a1e-496e-98f5-038837d033ad tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:05.791019 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-dbee1a5d-4a1e-496e-98f5-038837d033ad tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:05.883805 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-dbee1a5d-4a1e-496e-98f5-038837d033ad tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 200 len: 28606 microversion: 2.20 time: 0.107189 Aug 27 01:36:05.885017 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 504/959] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:36:05 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 28606 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:36:05.902419 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-6f87ce07-13a3-4b74-aa00-3f06db216905 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:05.903345 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-6f87ce07-13a3-4b74-aa00-3f06db216905 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:05.911347 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6f87ce07-13a3-4b74-aa00-3f06db216905 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:05.911796 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6f87ce07-13a3-4b74-aa00-3f06db216905 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:05.912568 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6f87ce07-13a3-4b74-aa00-3f06db216905 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:05.913041 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6f87ce07-13a3-4b74-aa00-3f06db216905 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:06.005492 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-6f87ce07-13a3-4b74-aa00-3f06db216905 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 20997 microversion: 2.1 time: 0.106578 Aug 27 01:36:06.006185 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 456/960] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:36:05 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 20997 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:36:06.536313 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-7a83a6f1-e58d-4999-96c2-40df5828c772 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:06.537034 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-7a83a6f1-e58d-4999-96c2-40df5828c772 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 8d6b5fb0-fd9d-41f2-ae08-3321565c5f39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:06.543961 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7a83a6f1-e58d-4999-96c2-40df5828c772 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:06.544403 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7a83a6f1-e58d-4999-96c2-40df5828c772 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:06.545323 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7a83a6f1-e58d-4999-96c2-40df5828c772 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:06.545821 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7a83a6f1-e58d-4999-96c2-40df5828c772 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:06.606177 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-7a83a6f1-e58d-4999-96c2-40df5828c772 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:06.613976 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-7a83a6f1-e58d-4999-96c2-40df5828c772 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39" status: 200 len: 1218 microversion: 2.1 time: 0.082201 Aug 27 01:36:06.614526 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 505/961] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:06 2021] GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:36:06.877401 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-f518ab30-b604-4bfe-b7b5-c1d58a8521c0 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Action: 'create', calling method: .version_select at 0x7ff214272160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-900072175"}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:06.896283 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-e7f6bf78-d7d5-4476-bf2e-9027326f5019 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:06.897212 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-e7f6bf78-d7d5-4476-bf2e-9027326f5019 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:06.903527 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e7f6bf78-d7d5-4476-bf2e-9027326f5019 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:06.903968 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e7f6bf78-d7d5-4476-bf2e-9027326f5019 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:06.904772 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e7f6bf78-d7d5-4476-bf2e-9027326f5019 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:06.905306 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e7f6bf78-d7d5-4476-bf2e-9027326f5019 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:06.909132 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-f518ab30-b604-4bfe-b7b5-c1d58a8521c0 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Getting quotas for project 0c906f0891a04908acd7dc34d1953279. Resources: {'key_pairs'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:36:06.912900 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-f518ab30-b604-4bfe-b7b5-c1d58a8521c0 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Getting quotas for user 34172ab8bb0942fda2a6aeda56a3bf21 and project 0c906f0891a04908acd7dc34d1953279. Resources: {'key_pairs'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:36:07.015006 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-e7f6bf78-d7d5-4476-bf2e-9027326f5019 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 200 len: 28606 microversion: 2.20 time: 0.122375 Aug 27 01:36:07.015614 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 506/962] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:36:06 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 28606 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 01:36:07.020785 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-667eaa17-161a-4262-a156-5e4821d85d77 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:07.021896 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-667eaa17-161a-4262-a156-5e4821d85d77 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:07.028462 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-667eaa17-161a-4262-a156-5e4821d85d77 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:07.028940 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-667eaa17-161a-4262-a156-5e4821d85d77 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:07.030296 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-667eaa17-161a-4262-a156-5e4821d85d77 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:07.030735 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-667eaa17-161a-4262-a156-5e4821d85d77 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:07.061819 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-f518ab30-b604-4bfe-b7b5-c1d58a8521c0 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Getting quotas for project 0c906f0891a04908acd7dc34d1953279. Resources: {'key_pairs'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:36:07.067171 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-f518ab30-b604-4bfe-b7b5-c1d58a8521c0 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Getting quotas for user 34172ab8bb0942fda2a6aeda56a3bf21 and project 0c906f0891a04908acd7dc34d1953279. Resources: {'key_pairs'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:36:07.080619 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-f518ab30-b604-4bfe-b7b5-c1d58a8521c0 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.208493 Aug 27 01:36:07.081248 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 457/963] 10.222.0.25 () {60 vars in 1158 bytes} [Fri Aug 27 01:36:06 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:36:07.127412 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-667eaa17-161a-4262-a156-5e4821d85d77 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 22897 microversion: 2.1 time: 0.110154 Aug 27 01:36:07.131412 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 507/964] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:36:07 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 22897 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:36:07.179607 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-a893a4cd-fb48-4102-ba93-f57e6c9d0c81 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1113327538", "imageRef": "f21b49b0-87d6-45ff-a26c-4bd3b3820394", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-900072175", "networks": [{"uuid": "917a1716-6372-44c1-be59-4f3ee33be285"}]}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:07.229325 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.network.neutron [None req-a893a4cd-fb48-4102-ba93-f57e6c9d0c81 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] validate_networks() for [('917a1716-6372-44c1-be59-4f3ee33be285', None, None, None, None, None)] {{(pid=108756) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 01:36:07.596635 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-a893a4cd-fb48-4102-ba93-f57e6c9d0c81 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Flavor limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 01:36:07.597168 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-a893a4cd-fb48-4102-ba93-f57e6c9d0c81 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Image limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 01:36:07.597705 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-a893a4cd-fb48-4102-ba93-f57e6c9d0c81 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Flavor pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 01:36:07.599002 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-a893a4cd-fb48-4102-ba93-f57e6c9d0c81 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Image pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 01:36:07.599428 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-a893a4cd-fb48-4102-ba93-f57e6c9d0c81 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 01:36:07.608520 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a893a4cd-fb48-4102-ba93-f57e6c9d0c81 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:07.609005 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a893a4cd-fb48-4102-ba93-f57e6c9d0c81 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:07.609792 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a893a4cd-fb48-4102-ba93-f57e6c9d0c81 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:07.610220 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a893a4cd-fb48-4102-ba93-f57e6c9d0c81 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:07.630504 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-a893a4cd-fb48-4102-ba93-f57e6c9d0c81 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Getting quotas for project 0c906f0891a04908acd7dc34d1953279. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:36:07.630833 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-598acf6f-0174-44cb-9ff9-c7e67c6c6539 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:07.631723 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-598acf6f-0174-44cb-9ff9-c7e67c6c6539 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 8d6b5fb0-fd9d-41f2-ae08-3321565c5f39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:07.635060 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-a893a4cd-fb48-4102-ba93-f57e6c9d0c81 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Getting quotas for user 34172ab8bb0942fda2a6aeda56a3bf21 and project 0c906f0891a04908acd7dc34d1953279. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:36:07.638623 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-598acf6f-0174-44cb-9ff9-c7e67c6c6539 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:07.639501 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-598acf6f-0174-44cb-9ff9-c7e67c6c6539 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:07.640445 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-598acf6f-0174-44cb-9ff9-c7e67c6c6539 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:07.640944 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-598acf6f-0174-44cb-9ff9-c7e67c6c6539 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:07.647414 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-a893a4cd-fb48-4102-ba93-f57e6c9d0c81 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Going to run 1 instances... {{(pid=108756) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 01:36:07.649797 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-a893a4cd-fb48-4102-ba93-f57e6c9d0c81 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f21b49b0-87d6-45ff-a26c-4bd3b3820394',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 01:36:07.719463 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-598acf6f-0174-44cb-9ff9-c7e67c6c6539 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:07.726998 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-598acf6f-0174-44cb-9ff9-c7e67c6c6539 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39" status: 200 len: 1274 microversion: 2.1 time: 0.100119 Aug 27 01:36:07.727864 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 508/965] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:07 2021] GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39 => generated 1274 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:36:07.742728 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-a893a4cd-fb48-4102-ba93-f57e6c9d0c81 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566744 Aug 27 01:36:07.743432 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 458/966] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Aug 27 01:36:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 01:36:07.754080 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-36359816-b193-42b7-90e4-4f77eab51910 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:07.754839 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-36359816-b193-42b7-90e4-4f77eab51910 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:07.827292 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-36359816-b193-42b7-90e4-4f77eab51910 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:07.834585 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-36359816-b193-42b7-90e4-4f77eab51910 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1258 microversion: 2.1 time: 0.084386 Aug 27 01:36:07.835208 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 509/967] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:07 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1258 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:36:08.026876 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-4dedc46c-2abb-450c-97e1-ca4a6684d592 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:08.027849 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-4dedc46c-2abb-450c-97e1-ca4a6684d592 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:08.034781 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4dedc46c-2abb-450c-97e1-ca4a6684d592 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:08.037140 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4dedc46c-2abb-450c-97e1-ca4a6684d592 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:08.038245 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4dedc46c-2abb-450c-97e1-ca4a6684d592 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:08.039891 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4dedc46c-2abb-450c-97e1-ca4a6684d592 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:08.138367 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-53b55f9c-bf7a-44b2-bbec-eb3ccc528698 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:08.139781 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-53b55f9c-bf7a-44b2-bbec-eb3ccc528698 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:08.145649 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-53b55f9c-bf7a-44b2-bbec-eb3ccc528698 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:08.146167 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-53b55f9c-bf7a-44b2-bbec-eb3ccc528698 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:08.150205 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-4dedc46c-2abb-450c-97e1-ca4a6684d592 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 200 len: 30465 microversion: 2.20 time: 0.127318 Aug 27 01:36:08.154124 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 459/968] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:36:08 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 30465 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:36:08.154260 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-53b55f9c-bf7a-44b2-bbec-eb3ccc528698 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:08.154260 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-53b55f9c-bf7a-44b2-bbec-eb3ccc528698 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:08.276883 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-53b55f9c-bf7a-44b2-bbec-eb3ccc528698 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 23804 microversion: 2.1 time: 0.140419 Aug 27 01:36:08.276883 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 510/969] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:36:08 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 23804 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:36:08.745268 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-20514063-572d-4559-932b-d2e1fdbaaaeb tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:08.745953 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-20514063-572d-4559-932b-d2e1fdbaaaeb tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 8d6b5fb0-fd9d-41f2-ae08-3321565c5f39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:08.752454 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-20514063-572d-4559-932b-d2e1fdbaaaeb tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:08.752944 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-20514063-572d-4559-932b-d2e1fdbaaaeb tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:08.753712 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-20514063-572d-4559-932b-d2e1fdbaaaeb tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:08.754144 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-20514063-572d-4559-932b-d2e1fdbaaaeb tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:08.852445 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-f5049df6-5469-469c-bc50-de8e97ea8d0e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:08.853031 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-f5049df6-5469-469c-bc50-de8e97ea8d0e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:08.860799 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f5049df6-5469-469c-bc50-de8e97ea8d0e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:08.861470 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f5049df6-5469-469c-bc50-de8e97ea8d0e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:08.862491 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f5049df6-5469-469c-bc50-de8e97ea8d0e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:08.863003 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f5049df6-5469-469c-bc50-de8e97ea8d0e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:08.877730 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-20514063-572d-4559-932b-d2e1fdbaaaeb tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:08.884811 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-20514063-572d-4559-932b-d2e1fdbaaaeb tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39" status: 200 len: 1314 microversion: 2.1 time: 0.143673 Aug 27 01:36:08.885600 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 460/970] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:08 2021] GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:36:08.937410 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-f5049df6-5469-469c-bc50-de8e97ea8d0e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:08.945120 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-f5049df6-5469-469c-bc50-de8e97ea8d0e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1262 microversion: 2.1 time: 0.097105 Aug 27 01:36:08.945608 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 511/971] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:08 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1262 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:36:09.162138 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-62612be6-f6c2-47ed-afe5-a158121fd8b0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:09.163040 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-62612be6-f6c2-47ed-afe5-a158121fd8b0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:09.168738 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-62612be6-f6c2-47ed-afe5-a158121fd8b0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:09.169232 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-62612be6-f6c2-47ed-afe5-a158121fd8b0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:09.169973 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-62612be6-f6c2-47ed-afe5-a158121fd8b0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:09.170434 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-62612be6-f6c2-47ed-afe5-a158121fd8b0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:09.265673 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-62612be6-f6c2-47ed-afe5-a158121fd8b0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 200 len: 32296 microversion: 2.20 time: 0.106891 Aug 27 01:36:09.266322 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 461/972] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:36:09 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 32296 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 01:36:09.286232 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-33da1e1c-db87-4dca-8aa2-95061285f500 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:09.290883 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-33da1e1c-db87-4dca-8aa2-95061285f500 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:09.293343 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-33da1e1c-db87-4dca-8aa2-95061285f500 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:09.293795 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-33da1e1c-db87-4dca-8aa2-95061285f500 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:09.294551 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-33da1e1c-db87-4dca-8aa2-95061285f500 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:09.294977 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-33da1e1c-db87-4dca-8aa2-95061285f500 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:09.388263 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-c33b1d36-1488-4a5b-a56d-6c399978a994 req-ea03bdcc-9942-47d2-aeaa-3de07dabe18a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d6b5fb0-fd9d-41f2-ae08-3321565c5f39", "tag": "e2c055ab-51cf-42da-b9db-cd0f000b188e"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:09.390435 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:36:09.390435 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:36:09.398054 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-c33b1d36-1488-4a5b-a56d-6c399978a994 req-ea03bdcc-9942-47d2-aeaa-3de07dabe18a service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:09.398491 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-c33b1d36-1488-4a5b-a56d-6c399978a994 req-ea03bdcc-9942-47d2-aeaa-3de07dabe18a service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:09.403185 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-33da1e1c-db87-4dca-8aa2-95061285f500 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 25532 microversion: 2.1 time: 0.120520 Aug 27 01:36:09.404549 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 512/973] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:36:09 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 25532 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:36:09.410179 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-c33b1d36-1488-4a5b-a56d-6c399978a994 req-ea03bdcc-9942-47d2-aeaa-3de07dabe18a service nova] Creating event network-changed:e2c055ab-51cf-42da-b9db-cd0f000b188e for instance 8d6b5fb0-fd9d-41f2-ae08-3321565c5f39 on hv-cinder-75916 Aug 27 01:36:09.414635 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-c33b1d36-1488-4a5b-a56d-6c399978a994 req-ea03bdcc-9942-47d2-aeaa-3de07dabe18a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030270 Aug 27 01:36:09.416161 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 462/974] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:36:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:36:09.903935 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-339dd66e-2d33-4a5f-83f8-620d36ac9e7c tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:09.905333 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-339dd66e-2d33-4a5f-83f8-620d36ac9e7c tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 8d6b5fb0-fd9d-41f2-ae08-3321565c5f39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:09.911784 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-339dd66e-2d33-4a5f-83f8-620d36ac9e7c tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:09.912228 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-339dd66e-2d33-4a5f-83f8-620d36ac9e7c tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:09.913052 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-339dd66e-2d33-4a5f-83f8-620d36ac9e7c tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:09.913483 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-339dd66e-2d33-4a5f-83f8-620d36ac9e7c tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:09.962761 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-f20a0d4d-aeab-4347-9191-eada992d038c tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:09.963620 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-f20a0d4d-aeab-4347-9191-eada992d038c tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:09.970401 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f20a0d4d-aeab-4347-9191-eada992d038c tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:09.970848 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f20a0d4d-aeab-4347-9191-eada992d038c tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:09.971624 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f20a0d4d-aeab-4347-9191-eada992d038c tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:09.972194 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f20a0d4d-aeab-4347-9191-eada992d038c tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:10.039087 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-f20a0d4d-aeab-4347-9191-eada992d038c tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:10.047148 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-f20a0d4d-aeab-4347-9191-eada992d038c tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1318 microversion: 2.1 time: 0.088710 Aug 27 01:36:10.048369 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 463/975] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:09 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1318 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:36:10.184530 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-339dd66e-2d33-4a5f-83f8-620d36ac9e7c tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:10.192292 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-339dd66e-2d33-4a5f-83f8-620d36ac9e7c tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39" status: 200 len: 1314 microversion: 2.1 time: 0.292771 Aug 27 01:36:10.194884 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 513/976] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:09 2021] GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:36:10.277331 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-fc09d8eb-725e-4a4d-8791-442e2199e219 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:10.278242 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-fc09d8eb-725e-4a4d-8791-442e2199e219 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:10.285010 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fc09d8eb-725e-4a4d-8791-442e2199e219 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:10.285762 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fc09d8eb-725e-4a4d-8791-442e2199e219 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:10.286417 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fc09d8eb-725e-4a4d-8791-442e2199e219 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:10.286850 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fc09d8eb-725e-4a4d-8791-442e2199e219 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:10.401973 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-fc09d8eb-725e-4a4d-8791-442e2199e219 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 200 len: 33450 microversion: 2.20 time: 0.128260 Aug 27 01:36:10.404190 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 464/977] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:36:10 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 33450 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:36:10.414209 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-1c2cee6e-49c4-4b66-8aa1-b9d84f843014 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:10.415737 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-1c2cee6e-49c4-4b66-8aa1-b9d84f843014 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:10.427216 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1c2cee6e-49c4-4b66-8aa1-b9d84f843014 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:10.427216 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1c2cee6e-49c4-4b66-8aa1-b9d84f843014 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:10.427216 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1c2cee6e-49c4-4b66-8aa1-b9d84f843014 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:10.427216 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1c2cee6e-49c4-4b66-8aa1-b9d84f843014 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:10.583784 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-1c2cee6e-49c4-4b66-8aa1-b9d84f843014 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 26775 microversion: 2.1 time: 0.173089 Aug 27 01:36:10.587982 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 514/978] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:36:10 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 26775 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:36:11.068475 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-304d910e-1741-4086-8f05-de7fa3e68753 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:11.069508 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-304d910e-1741-4086-8f05-de7fa3e68753 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:11.084988 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-304d910e-1741-4086-8f05-de7fa3e68753 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:11.085554 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-304d910e-1741-4086-8f05-de7fa3e68753 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:11.086844 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-304d910e-1741-4086-8f05-de7fa3e68753 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:11.088138 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-304d910e-1741-4086-8f05-de7fa3e68753 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:11.211770 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-be055145-b1a3-48ad-af4c-2ebbcafc06aa tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:11.212400 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-be055145-b1a3-48ad-af4c-2ebbcafc06aa tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 8d6b5fb0-fd9d-41f2-ae08-3321565c5f39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:11.226300 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-be055145-b1a3-48ad-af4c-2ebbcafc06aa tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:11.226767 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-be055145-b1a3-48ad-af4c-2ebbcafc06aa tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:11.227589 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-be055145-b1a3-48ad-af4c-2ebbcafc06aa tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:11.228024 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-be055145-b1a3-48ad-af4c-2ebbcafc06aa tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:11.307513 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-304d910e-1741-4086-8f05-de7fa3e68753 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:11.328914 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-304d910e-1741-4086-8f05-de7fa3e68753 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1358 microversion: 2.1 time: 0.266635 Aug 27 01:36:11.333349 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 465/979] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:11 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1358 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:36:11.411545 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-be055145-b1a3-48ad-af4c-2ebbcafc06aa tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:11.414752 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-f5825ebe-da6d-4d07-bc31-7390a8c02d7b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:11.415673 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-f5825ebe-da6d-4d07-bc31-7390a8c02d7b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:11.423660 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f5825ebe-da6d-4d07-bc31-7390a8c02d7b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:11.424099 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f5825ebe-da6d-4d07-bc31-7390a8c02d7b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:11.424265 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-be055145-b1a3-48ad-af4c-2ebbcafc06aa tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39" status: 200 len: 1314 microversion: 2.1 time: 0.217883 Aug 27 01:36:11.425165 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f5825ebe-da6d-4d07-bc31-7390a8c02d7b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:11.425599 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f5825ebe-da6d-4d07-bc31-7390a8c02d7b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:11.426455 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 515/980] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:11 2021] GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:36:11.596551 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-edefee06-6b82-4dde-9595-4159d4b699cc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:11.597430 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-edefee06-6b82-4dde-9595-4159d4b699cc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:11.603477 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-edefee06-6b82-4dde-9595-4159d4b699cc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:11.603921 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-edefee06-6b82-4dde-9595-4159d4b699cc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:11.604703 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-edefee06-6b82-4dde-9595-4159d4b699cc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:11.605176 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-edefee06-6b82-4dde-9595-4159d4b699cc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:22.420780 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-edefee06-6b82-4dde-9595-4159d4b699cc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 28645 microversion: 2.1 time: 10.828319 Aug 27 01:36:22.425729 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 516/981] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:36:11 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 28645 bytes in 10830 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:36:22.429236 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-da66c599-b6c3-46c8-ac62-0286c7ec4696 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:22.430014 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-da66c599-b6c3-46c8-ac62-0286c7ec4696 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:22.436139 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-da66c599-b6c3-46c8-ac62-0286c7ec4696 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:22.436672 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-da66c599-b6c3-46c8-ac62-0286c7ec4696 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:22.437534 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-da66c599-b6c3-46c8-ac62-0286c7ec4696 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:22.438549 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-da66c599-b6c3-46c8-ac62-0286c7ec4696 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:22.451159 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-f5825ebe-da6d-4d07-bc31-7390a8c02d7b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 200 len: 38300 microversion: 2.20 time: 11.039900 Aug 27 01:36:22.451955 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 466/982] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:36:11 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 38300 bytes in 11041 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:36:22.457036 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-b3a39700-5443-4dc1-9b14-0ed96f38e0b4 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:22.457837 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-b3a39700-5443-4dc1-9b14-0ed96f38e0b4 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 8d6b5fb0-fd9d-41f2-ae08-3321565c5f39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:22.466513 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b3a39700-5443-4dc1-9b14-0ed96f38e0b4 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:22.466513 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b3a39700-5443-4dc1-9b14-0ed96f38e0b4 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:22.466513 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b3a39700-5443-4dc1-9b14-0ed96f38e0b4 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:22.466513 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b3a39700-5443-4dc1-9b14-0ed96f38e0b4 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:22.588782 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-b3a39700-5443-4dc1-9b14-0ed96f38e0b4 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:22.596443 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-b3a39700-5443-4dc1-9b14-0ed96f38e0b4 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39" status: 200 len: 1314 microversion: 2.1 time: 0.143231 Aug 27 01:36:22.597134 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 467/983] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:22 2021] GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:36:22.611021 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-19f1e03a-eed3-4399-9e45-782053148ca6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:22.620194 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-19f1e03a-eed3-4399-9e45-782053148ca6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:22.620194 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-19f1e03a-eed3-4399-9e45-782053148ca6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:22.620194 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-19f1e03a-eed3-4399-9e45-782053148ca6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:22.620194 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-19f1e03a-eed3-4399-9e45-782053148ca6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:22.620733 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-19f1e03a-eed3-4399-9e45-782053148ca6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:22.642014 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-19f1e03a-eed3-4399-9e45-782053148ca6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/ips" status: 200 len: 151 microversion: 2.20 time: 0.035188 Aug 27 01:36:22.642585 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 468/984] 10.222.0.25 () {60 vars in 1289 bytes} [Fri Aug 27 01:36:22 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:36:22.646677 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-da66c599-b6c3-46c8-ac62-0286c7ec4696 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:22.654275 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-da66c599-b6c3-46c8-ac62-0286c7ec4696 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1358 microversion: 2.1 time: 0.230515 Aug 27 01:36:22.654832 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 517/985] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:22 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1358 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:36:23.270918 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-703e11e7-645e-421f-a8f3-65bd92145490 req-d746d869-3410-41f5-8513-208d48fd13ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05daee4f-8e0c-4b0f-955f-09527893b2fa", "tag": "ecfa3830-4bf2-43df-94c3-c0d06632b36e"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:23.272891 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:36:23.272891 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:36:23.288349 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-703e11e7-645e-421f-a8f3-65bd92145490 req-d746d869-3410-41f5-8513-208d48fd13ba service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:23.288786 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-703e11e7-645e-421f-a8f3-65bd92145490 req-d746d869-3410-41f5-8513-208d48fd13ba service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:23.301297 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-703e11e7-645e-421f-a8f3-65bd92145490 req-d746d869-3410-41f5-8513-208d48fd13ba service nova] Creating event network-changed:ecfa3830-4bf2-43df-94c3-c0d06632b36e for instance 05daee4f-8e0c-4b0f-955f-09527893b2fa on hv-cinder-75916 Aug 27 01:36:23.306527 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-703e11e7-645e-421f-a8f3-65bd92145490 req-d746d869-3410-41f5-8513-208d48fd13ba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040711 Aug 27 01:36:23.307631 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 469/986] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:36:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:36:23.433772 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-7ad99958-481a-4db6-8ab5-2d006ec8e75d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:23.435215 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-7ad99958-481a-4db6-8ab5-2d006ec8e75d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:23.442898 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7ad99958-481a-4db6-8ab5-2d006ec8e75d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:23.443421 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7ad99958-481a-4db6-8ab5-2d006ec8e75d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:23.444207 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7ad99958-481a-4db6-8ab5-2d006ec8e75d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:23.444548 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7ad99958-481a-4db6-8ab5-2d006ec8e75d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:23.532355 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-7ad99958-481a-4db6-8ab5-2d006ec8e75d tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 28645 microversion: 2.1 time: 0.100594 Aug 27 01:36:23.532355 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 518/987] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:36:23 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 28645 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:36:23.614212 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-5f3b833d-1fe3-4015-a8af-bbda68f371f3 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:23.614821 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-5f3b833d-1fe3-4015-a8af-bbda68f371f3 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 8d6b5fb0-fd9d-41f2-ae08-3321565c5f39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:23.620947 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5f3b833d-1fe3-4015-a8af-bbda68f371f3 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:23.621545 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5f3b833d-1fe3-4015-a8af-bbda68f371f3 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:23.622308 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5f3b833d-1fe3-4015-a8af-bbda68f371f3 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:23.622745 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5f3b833d-1fe3-4015-a8af-bbda68f371f3 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:23.671573 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-df771ae6-bf8d-48d5-bacc-a1bc8d1ce19f tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:23.672467 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-df771ae6-bf8d-48d5-bacc-a1bc8d1ce19f tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:23.679537 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-df771ae6-bf8d-48d5-bacc-a1bc8d1ce19f tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:23.680047 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-df771ae6-bf8d-48d5-bacc-a1bc8d1ce19f tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:23.681072 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-df771ae6-bf8d-48d5-bacc-a1bc8d1ce19f tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:23.681532 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-df771ae6-bf8d-48d5-bacc-a1bc8d1ce19f tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:23.748526 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-5f3b833d-1fe3-4015-a8af-bbda68f371f3 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:23.756674 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-5f3b833d-1fe3-4015-a8af-bbda68f371f3 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39" status: 200 len: 1314 microversion: 2.1 time: 0.147027 Aug 27 01:36:23.757281 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 470/988] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:23 2021] GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:36:23.874050 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-df771ae6-bf8d-48d5-bacc-a1bc8d1ce19f tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:23.882082 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-df771ae6-bf8d-48d5-bacc-a1bc8d1ce19f tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1358 microversion: 2.1 time: 0.214540 Aug 27 01:36:23.882644 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 519/989] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:23 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:36:24.541943 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-cbde3bbe-0425-495b-b237-b14dca02eb2c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:24.542873 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-cbde3bbe-0425-495b-b237-b14dca02eb2c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:24.549802 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cbde3bbe-0425-495b-b237-b14dca02eb2c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:24.550250 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cbde3bbe-0425-495b-b237-b14dca02eb2c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:24.551005 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cbde3bbe-0425-495b-b237-b14dca02eb2c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:24.551439 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cbde3bbe-0425-495b-b237-b14dca02eb2c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:24.647319 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-cbde3bbe-0425-495b-b237-b14dca02eb2c tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 29955 microversion: 2.1 time: 0.108874 Aug 27 01:36:24.647999 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 471/990] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:36:24 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 29955 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:36:24.773323 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-396dafbf-66b0-4f52-b76b-4f85bf77e610 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:24.773851 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-396dafbf-66b0-4f52-b76b-4f85bf77e610 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 8d6b5fb0-fd9d-41f2-ae08-3321565c5f39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:24.780357 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-396dafbf-66b0-4f52-b76b-4f85bf77e610 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:24.780868 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-396dafbf-66b0-4f52-b76b-4f85bf77e610 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:24.782373 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-396dafbf-66b0-4f52-b76b-4f85bf77e610 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:24.782823 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-396dafbf-66b0-4f52-b76b-4f85bf77e610 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:24.899414 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-df2c64d8-91a3-4196-a4d9-63ead6449e88 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:24.900283 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-df2c64d8-91a3-4196-a4d9-63ead6449e88 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:24.907944 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-df2c64d8-91a3-4196-a4d9-63ead6449e88 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:24.908391 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-df2c64d8-91a3-4196-a4d9-63ead6449e88 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:24.908888 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-396dafbf-66b0-4f52-b76b-4f85bf77e610 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:24.909223 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-df2c64d8-91a3-4196-a4d9-63ead6449e88 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:24.909659 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-df2c64d8-91a3-4196-a4d9-63ead6449e88 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:24.916218 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-396dafbf-66b0-4f52-b76b-4f85bf77e610 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39" status: 200 len: 1314 microversion: 2.1 time: 0.146752 Aug 27 01:36:24.917410 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 520/991] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:24 2021] GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:36:25.034647 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-df2c64d8-91a3-4196-a4d9-63ead6449e88 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:25.041804 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-df2c64d8-91a3-4196-a4d9-63ead6449e88 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1358 microversion: 2.1 time: 0.146482 Aug 27 01:36:25.042372 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 472/992] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:24 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:36:25.224311 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-10fc81b3-dd32-4325-a2ee-3ea9ada0ed22 req-b95ca258-bdde-49e0-b6d8-5b114b7dbe36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d6b5fb0-fd9d-41f2-ae08-3321565c5f39", "name": "network-vif-plugged", "status": "completed", "tag": "e2c055ab-51cf-42da-b9db-cd0f000b188e"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:25.224491 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:36:25.224491 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:36:25.231224 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-10fc81b3-dd32-4325-a2ee-3ea9ada0ed22 req-b95ca258-bdde-49e0-b6d8-5b114b7dbe36 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:25.231667 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-10fc81b3-dd32-4325-a2ee-3ea9ada0ed22 req-b95ca258-bdde-49e0-b6d8-5b114b7dbe36 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:25.242459 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-10fc81b3-dd32-4325-a2ee-3ea9ada0ed22 req-b95ca258-bdde-49e0-b6d8-5b114b7dbe36 service nova] Creating event network-vif-plugged:e2c055ab-51cf-42da-b9db-cd0f000b188e for instance 8d6b5fb0-fd9d-41f2-ae08-3321565c5f39 on hv-cinder-75916 Aug 27 01:36:25.247171 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-10fc81b3-dd32-4325-a2ee-3ea9ada0ed22 req-b95ca258-bdde-49e0-b6d8-5b114b7dbe36 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142931 Aug 27 01:36:25.247748 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 521/993] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:36:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:36:25.267712 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-58b29ef3-2cf4-43f3-9fa3-a4063a0c1674 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:25.268383 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-58b29ef3-2cf4-43f3-9fa3-a4063a0c1674 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:25.274221 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-58b29ef3-2cf4-43f3-9fa3-a4063a0c1674 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:25.274747 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-58b29ef3-2cf4-43f3-9fa3-a4063a0c1674 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:25.275653 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-58b29ef3-2cf4-43f3-9fa3-a4063a0c1674 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:25.276474 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-58b29ef3-2cf4-43f3-9fa3-a4063a0c1674 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:25.299921 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.objects.instance [None req-58b29ef3-2cf4-43f3-9fa3-a4063a0c1674 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lazy-loading 'flavor' on Instance uuid 3b8f116a-f7c5-4c53-83b6-22034d528599 {{(pid=108756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:36:25.659577 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-ae10919e-e85a-434e-b7e2-853a07e47fb7 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:25.660569 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-ae10919e-e85a-434e-b7e2-853a07e47fb7 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:25.666893 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ae10919e-e85a-434e-b7e2-853a07e47fb7 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:25.668003 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ae10919e-e85a-434e-b7e2-853a07e47fb7 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:25.668261 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ae10919e-e85a-434e-b7e2-853a07e47fb7 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:25.668685 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ae10919e-e85a-434e-b7e2-853a07e47fb7 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:25.768103 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-ae10919e-e85a-434e-b7e2-853a07e47fb7 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 31973 microversion: 2.1 time: 0.112432 Aug 27 01:36:25.768806 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 522/994] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:36:25 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 31973 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:36:25.934477 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-062db912-d2d8-4e75-9f1a-5e468d9bc7f2 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:25.935107 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-062db912-d2d8-4e75-9f1a-5e468d9bc7f2 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 8d6b5fb0-fd9d-41f2-ae08-3321565c5f39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:25.942219 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-062db912-d2d8-4e75-9f1a-5e468d9bc7f2 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:25.942672 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-062db912-d2d8-4e75-9f1a-5e468d9bc7f2 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:25.943441 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-062db912-d2d8-4e75-9f1a-5e468d9bc7f2 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:25.943878 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-062db912-d2d8-4e75-9f1a-5e468d9bc7f2 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:26.062043 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-58b29ef3-2cf4-43f3-9fa3-a4063a0c1674 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 202 len: 0 microversion: 2.20 time: 0.798520 Aug 27 01:36:26.066064 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 473/995] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:36:25 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 0 bytes in 800 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 01:36:26.069315 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-a3871ccd-6d6e-4ae8-bc52-e56f9513f40f tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:26.069635 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-062db912-d2d8-4e75-9f1a-5e468d9bc7f2 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:26.070002 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-a3871ccd-6d6e-4ae8-bc52-e56f9513f40f tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:26.076173 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a3871ccd-6d6e-4ae8-bc52-e56f9513f40f tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:26.076616 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a3871ccd-6d6e-4ae8-bc52-e56f9513f40f tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:26.077055 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-062db912-d2d8-4e75-9f1a-5e468d9bc7f2 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39" status: 200 len: 1314 microversion: 2.1 time: 0.146657 Aug 27 01:36:26.077400 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a3871ccd-6d6e-4ae8-bc52-e56f9513f40f tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:26.077628 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 523/996] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:25 2021] GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:36:26.077829 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a3871ccd-6d6e-4ae8-bc52-e56f9513f40f tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:26.082448 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-fdd53b09-25b5-4c49-9120-01de746499b6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:26.083052 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-fdd53b09-25b5-4c49-9120-01de746499b6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:26.088701 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fdd53b09-25b5-4c49-9120-01de746499b6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:26.089185 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fdd53b09-25b5-4c49-9120-01de746499b6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:26.089957 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fdd53b09-25b5-4c49-9120-01de746499b6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:26.090392 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fdd53b09-25b5-4c49-9120-01de746499b6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:26.202692 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-a3871ccd-6d6e-4ae8-bc52-e56f9513f40f tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:26.210875 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-a3871ccd-6d6e-4ae8-bc52-e56f9513f40f tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1358 microversion: 2.1 time: 0.146788 Aug 27 01:36:26.214640 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 474/997] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:26 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:36:26.218902 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-fdd53b09-25b5-4c49-9120-01de746499b6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:26.227910 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-fdd53b09-25b5-4c49-9120-01de746499b6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:26.229447 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-fdd53b09-25b5-4c49-9120-01de746499b6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:26.230572 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-fdd53b09-25b5-4c49-9120-01de746499b6 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1723 microversion: 2.20 time: 0.152054 Aug 27 01:36:26.231107 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 524/998] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:36:26 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:36:26.779524 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-085b9c69-c8c2-4b76-8d5d-66384f190bca tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:26.780609 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-085b9c69-c8c2-4b76-8d5d-66384f190bca tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:26.786707 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-085b9c69-c8c2-4b76-8d5d-66384f190bca tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:26.787182 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-085b9c69-c8c2-4b76-8d5d-66384f190bca tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:26.787948 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-085b9c69-c8c2-4b76-8d5d-66384f190bca tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:26.788381 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-085b9c69-c8c2-4b76-8d5d-66384f190bca tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:26.960661 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-085b9c69-c8c2-4b76-8d5d-66384f190bca tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 33314 microversion: 2.1 time: 0.184562 Aug 27 01:36:26.961605 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 475/999] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:36:26 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 33314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:36:27.094298 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-3d9a9bf1-c235-44c6-a5a0-2479c6a16503 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:27.095018 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-3d9a9bf1-c235-44c6-a5a0-2479c6a16503 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 8d6b5fb0-fd9d-41f2-ae08-3321565c5f39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:27.101712 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3d9a9bf1-c235-44c6-a5a0-2479c6a16503 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:27.102170 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3d9a9bf1-c235-44c6-a5a0-2479c6a16503 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:27.103007 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3d9a9bf1-c235-44c6-a5a0-2479c6a16503 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:27.103450 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3d9a9bf1-c235-44c6-a5a0-2479c6a16503 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:27.228700 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-dab6b596-9a63-4efc-ba69-5330b84d4da2 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:27.229456 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-dab6b596-9a63-4efc-ba69-5330b84d4da2 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:27.238501 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-dab6b596-9a63-4efc-ba69-5330b84d4da2 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:27.238952 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-dab6b596-9a63-4efc-ba69-5330b84d4da2 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:27.239747 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-dab6b596-9a63-4efc-ba69-5330b84d4da2 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:27.240163 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-dab6b596-9a63-4efc-ba69-5330b84d4da2 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:27.279435 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-3d9a9bf1-c235-44c6-a5a0-2479c6a16503 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:27.289225 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-3d9a9bf1-c235-44c6-a5a0-2479c6a16503 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39" status: 200 len: 1314 microversion: 2.1 time: 0.198577 Aug 27 01:36:27.290007 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 525/1000] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:27 2021] GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:36:27.294575 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-349e024c-1145-45a6-b804-954f1cc93ae4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:27.295373 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-349e024c-1145-45a6-b804-954f1cc93ae4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:27.302202 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-349e024c-1145-45a6-b804-954f1cc93ae4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:27.302659 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-349e024c-1145-45a6-b804-954f1cc93ae4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:27.303434 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-349e024c-1145-45a6-b804-954f1cc93ae4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:27.304041 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-349e024c-1145-45a6-b804-954f1cc93ae4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:27.387236 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-dab6b596-9a63-4efc-ba69-5330b84d4da2 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:27.399635 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-dab6b596-9a63-4efc-ba69-5330b84d4da2 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1358 microversion: 2.1 time: 0.175483 Aug 27 01:36:27.400335 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 476/1001] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:27 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:36:27.541520 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-349e024c-1145-45a6-b804-954f1cc93ae4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:27.550107 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-349e024c-1145-45a6-b804-954f1cc93ae4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:27.551603 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-349e024c-1145-45a6-b804-954f1cc93ae4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:27.552723 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-349e024c-1145-45a6-b804-954f1cc93ae4 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1723 microversion: 2.20 time: 0.261659 Aug 27 01:36:27.553291 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 526/1002] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:36:27 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:36:27.972915 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-5ede165c-e182-4b99-bc48-b1d928738ccc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:27.973963 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-5ede165c-e182-4b99-bc48-b1d928738ccc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:27.980006 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5ede165c-e182-4b99-bc48-b1d928738ccc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:27.980466 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5ede165c-e182-4b99-bc48-b1d928738ccc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:27.981347 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5ede165c-e182-4b99-bc48-b1d928738ccc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:27.981826 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5ede165c-e182-4b99-bc48-b1d928738ccc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:28.102186 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-5ede165c-e182-4b99-bc48-b1d928738ccc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 33956 microversion: 2.1 time: 0.133193 Aug 27 01:36:28.102820 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 477/1003] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:36:27 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 33956 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:36:28.306471 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-7f3e75f1-6498-40c1-9c5d-d96186dd78fe tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:28.307027 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-7f3e75f1-6498-40c1-9c5d-d96186dd78fe tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 8d6b5fb0-fd9d-41f2-ae08-3321565c5f39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:28.313000 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7f3e75f1-6498-40c1-9c5d-d96186dd78fe tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:28.314191 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7f3e75f1-6498-40c1-9c5d-d96186dd78fe tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:28.315035 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7f3e75f1-6498-40c1-9c5d-d96186dd78fe tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:28.315504 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7f3e75f1-6498-40c1-9c5d-d96186dd78fe tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:28.416611 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-6062edfc-b494-43c5-9d04-5440e43797eb tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:28.417533 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-6062edfc-b494-43c5-9d04-5440e43797eb tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:28.425113 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6062edfc-b494-43c5-9d04-5440e43797eb tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:28.425681 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6062edfc-b494-43c5-9d04-5440e43797eb tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:28.426553 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6062edfc-b494-43c5-9d04-5440e43797eb tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:28.427058 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6062edfc-b494-43c5-9d04-5440e43797eb tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:28.435281 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-7f3e75f1-6498-40c1-9c5d-d96186dd78fe tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:28.443234 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-7f3e75f1-6498-40c1-9c5d-d96186dd78fe tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39" status: 200 len: 1497 microversion: 2.1 time: 0.140562 Aug 27 01:36:28.443836 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 527/1004] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:28 2021] GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39 => generated 1497 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:36:28.548654 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-6062edfc-b494-43c5-9d04-5440e43797eb tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:28.556059 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-6062edfc-b494-43c5-9d04-5440e43797eb tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1358 microversion: 2.1 time: 0.143535 Aug 27 01:36:28.560703 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 478/1005] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:28 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:36:28.570430 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-3d047e89-2d63-4983-9452-f555d99773d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:28.571040 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-3d047e89-2d63-4983-9452-f555d99773d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:28.576862 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3d047e89-2d63-4983-9452-f555d99773d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:28.577314 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3d047e89-2d63-4983-9452-f555d99773d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:28.578127 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3d047e89-2d63-4983-9452-f555d99773d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:28.578559 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3d047e89-2d63-4983-9452-f555d99773d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:28.705914 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-3d047e89-2d63-4983-9452-f555d99773d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:28.713770 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-3d047e89-2d63-4983-9452-f555d99773d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:28.715276 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-3d047e89-2d63-4983-9452-f555d99773d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:28.716411 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-3d047e89-2d63-4983-9452-f555d99773d7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1723 microversion: 2.20 time: 0.149704 Aug 27 01:36:28.716987 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 528/1006] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:36:28 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:36:29.109096 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-760b4efa-5add-4012-881f-0b78d5dc4b8f req-b3b5474e-b725-440e-9705-0a63454f6cbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05daee4f-8e0c-4b0f-955f-09527893b2fa", "name": "network-vif-plugged", "status": "completed", "tag": "ecfa3830-4bf2-43df-94c3-c0d06632b36e"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:29.111040 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:36:29.111040 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:36:29.114178 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-2c1fb476-7f37-4d51-9d96-c53ef3747782 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:29.115262 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-2c1fb476-7f37-4d51-9d96-c53ef3747782 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:29.117842 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-760b4efa-5add-4012-881f-0b78d5dc4b8f req-b3b5474e-b725-440e-9705-0a63454f6cbe service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:29.118289 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-760b4efa-5add-4012-881f-0b78d5dc4b8f req-b3b5474e-b725-440e-9705-0a63454f6cbe service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:29.121543 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2c1fb476-7f37-4d51-9d96-c53ef3747782 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:29.122099 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2c1fb476-7f37-4d51-9d96-c53ef3747782 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:29.122922 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2c1fb476-7f37-4d51-9d96-c53ef3747782 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:29.123359 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2c1fb476-7f37-4d51-9d96-c53ef3747782 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:29.129160 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-760b4efa-5add-4012-881f-0b78d5dc4b8f req-b3b5474e-b725-440e-9705-0a63454f6cbe service nova] Creating event network-vif-plugged:ecfa3830-4bf2-43df-94c3-c0d06632b36e for instance 05daee4f-8e0c-4b0f-955f-09527893b2fa on hv-cinder-75916 Aug 27 01:36:29.133941 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-760b4efa-5add-4012-881f-0b78d5dc4b8f req-b3b5474e-b725-440e-9705-0a63454f6cbe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028814 Aug 27 01:36:29.134515 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 479/1007] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:36:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:36:29.255718 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-2c1fb476-7f37-4d51-9d96-c53ef3747782 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 34940 microversion: 2.1 time: 0.145422 Aug 27 01:36:29.259778 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 529/1008] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:36:29 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 34940 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:36:29.357514 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-0a2c1479-e48f-49cb-98a0-4809ea4ef9c6 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:29.358016 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-0a2c1479-e48f-49cb-98a0-4809ea4ef9c6 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 8d6b5fb0-fd9d-41f2-ae08-3321565c5f39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:29.364102 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0a2c1479-e48f-49cb-98a0-4809ea4ef9c6 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:29.364550 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0a2c1479-e48f-49cb-98a0-4809ea4ef9c6 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:29.365457 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0a2c1479-e48f-49cb-98a0-4809ea4ef9c6 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:29.365898 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0a2c1479-e48f-49cb-98a0-4809ea4ef9c6 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:29.390679 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-0a2c1479-e48f-49cb-98a0-4809ea4ef9c6 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 8d6b5fb0-fd9d-41f2-ae08-3321565c5f39] Going to try to terminate instance {{(pid=108756) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 01:36:29.574490 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-6d8b11b7-53df-4fdf-b879-8a0154e09f35 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:29.575311 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-6d8b11b7-53df-4fdf-b879-8a0154e09f35 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:29.582768 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6d8b11b7-53df-4fdf-b879-8a0154e09f35 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:29.583206 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6d8b11b7-53df-4fdf-b879-8a0154e09f35 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:29.583966 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6d8b11b7-53df-4fdf-b879-8a0154e09f35 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:29.584389 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6d8b11b7-53df-4fdf-b879-8a0154e09f35 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:29.660258 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-0a2c1479-e48f-49cb-98a0-4809ea4ef9c6 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39" status: 204 len: 0 microversion: 2.1 time: 0.306609 Aug 27 01:36:29.661004 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 480/1009] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Aug 27 01:36:29 2021] DELETE /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 01:36:29.669062 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-3d137a13-ee70-4aac-91b1-b334bd1ea801 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:29.669752 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-3d137a13-ee70-4aac-91b1-b334bd1ea801 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 8d6b5fb0-fd9d-41f2-ae08-3321565c5f39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:29.676135 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3d137a13-ee70-4aac-91b1-b334bd1ea801 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:29.676600 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3d137a13-ee70-4aac-91b1-b334bd1ea801 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:29.677388 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3d137a13-ee70-4aac-91b1-b334bd1ea801 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:29.677821 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3d137a13-ee70-4aac-91b1-b334bd1ea801 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:29.708125 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-6d8b11b7-53df-4fdf-b879-8a0154e09f35 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:29.715417 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-6d8b11b7-53df-4fdf-b879-8a0154e09f35 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1358 microversion: 2.1 time: 0.145380 Aug 27 01:36:29.715974 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 530/1010] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:29 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:36:29.734243 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-8fcd194a-1b63-403c-9745-3d591774aad2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:29.734956 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-8fcd194a-1b63-403c-9745-3d591774aad2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:29.740911 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8fcd194a-1b63-403c-9745-3d591774aad2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:29.741432 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8fcd194a-1b63-403c-9745-3d591774aad2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:29.742264 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8fcd194a-1b63-403c-9745-3d591774aad2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:29.742760 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8fcd194a-1b63-403c-9745-3d591774aad2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:29.803804 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-3d137a13-ee70-4aac-91b1-b334bd1ea801 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:29.811076 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-3d137a13-ee70-4aac-91b1-b334bd1ea801 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39" status: 200 len: 1503 microversion: 2.1 time: 0.145845 Aug 27 01:36:29.811646 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 481/1011] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:29 2021] GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39 => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:36:29.867171 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-8fcd194a-1b63-403c-9745-3d591774aad2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:29.874936 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-8fcd194a-1b63-403c-9745-3d591774aad2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:29.877105 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-8fcd194a-1b63-403c-9745-3d591774aad2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:29.878233 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-8fcd194a-1b63-403c-9745-3d591774aad2 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1723 microversion: 2.20 time: 0.147626 Aug 27 01:36:29.878778 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 531/1012] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:36:29 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:36:30.267444 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-bdfe4445-eba5-4774-9a38-5185272408d4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:30.268356 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-bdfe4445-eba5-4774-9a38-5185272408d4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:30.275018 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bdfe4445-eba5-4774-9a38-5185272408d4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:30.275467 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bdfe4445-eba5-4774-9a38-5185272408d4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:30.276231 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bdfe4445-eba5-4774-9a38-5185272408d4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:30.276663 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-bdfe4445-eba5-4774-9a38-5185272408d4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:30.385053 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-bdfe4445-eba5-4774-9a38-5185272408d4 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 36032 microversion: 2.1 time: 0.121128 Aug 27 01:36:30.385682 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 482/1013] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:36:30 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 36032 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:36:30.731293 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-2ef40eba-475a-4be9-9594-49ce7cdeba16 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:30.732031 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-2ef40eba-475a-4be9-9594-49ce7cdeba16 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:30.738349 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2ef40eba-475a-4be9-9594-49ce7cdeba16 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:30.738791 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2ef40eba-475a-4be9-9594-49ce7cdeba16 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:30.739581 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2ef40eba-475a-4be9-9594-49ce7cdeba16 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:30.740011 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2ef40eba-475a-4be9-9594-49ce7cdeba16 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:30.828719 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-6e6c4152-fa45-4fca-b41f-a5a6749a750c tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:30.830170 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-6e6c4152-fa45-4fca-b41f-a5a6749a750c tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 8d6b5fb0-fd9d-41f2-ae08-3321565c5f39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:30.836700 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6e6c4152-fa45-4fca-b41f-a5a6749a750c tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:30.837266 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6e6c4152-fa45-4fca-b41f-a5a6749a750c tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:30.838087 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6e6c4152-fa45-4fca-b41f-a5a6749a750c tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:30.838520 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6e6c4152-fa45-4fca-b41f-a5a6749a750c tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:30.862584 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-2ef40eba-475a-4be9-9594-49ce7cdeba16 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:30.869812 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-2ef40eba-475a-4be9-9594-49ce7cdeba16 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1358 microversion: 2.1 time: 0.142147 Aug 27 01:36:30.870374 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 532/1014] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:30 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1358 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:36:30.896236 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-5efee202-a70b-487d-8332-f5f1b6f227e7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:30.896866 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-5efee202-a70b-487d-8332-f5f1b6f227e7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:30.902925 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5efee202-a70b-487d-8332-f5f1b6f227e7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:30.904010 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5efee202-a70b-487d-8332-f5f1b6f227e7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:30.904236 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5efee202-a70b-487d-8332-f5f1b6f227e7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:30.904720 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5efee202-a70b-487d-8332-f5f1b6f227e7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:30.965315 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-6e6c4152-fa45-4fca-b41f-a5a6749a750c tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:30.973019 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-6e6c4152-fa45-4fca-b41f-a5a6749a750c tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39" status: 200 len: 1503 microversion: 2.1 time: 0.148238 Aug 27 01:36:30.973584 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 483/1015] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:30 2021] GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39 => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:36:31.030655 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-5efee202-a70b-487d-8332-f5f1b6f227e7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:31.039135 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-5efee202-a70b-487d-8332-f5f1b6f227e7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:31.040673 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-5efee202-a70b-487d-8332-f5f1b6f227e7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:31.041835 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-5efee202-a70b-487d-8332-f5f1b6f227e7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1723 microversion: 2.20 time: 0.150121 Aug 27 01:36:31.042555 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 533/1016] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:36:30 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:36:31.397734 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-f55b553f-6de1-4d18-9568-363655c5d474 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:31.398635 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-f55b553f-6de1-4d18-9568-363655c5d474 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:31.404631 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f55b553f-6de1-4d18-9568-363655c5d474 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:31.405107 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f55b553f-6de1-4d18-9568-363655c5d474 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:31.406369 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f55b553f-6de1-4d18-9568-363655c5d474 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:31.406805 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f55b553f-6de1-4d18-9568-363655c5d474 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:31.562287 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-f55b553f-6de1-4d18-9568-363655c5d474 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 37353 microversion: 2.1 time: 0.168149 Aug 27 01:36:31.562920 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 484/1017] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:36:31 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 37353 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:36:31.886322 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-3e8e1b16-caeb-4c87-a964-4d7f6aaec981 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:31.887064 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-3e8e1b16-caeb-4c87-a964-4d7f6aaec981 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:31.893576 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3e8e1b16-caeb-4c87-a964-4d7f6aaec981 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:31.894016 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3e8e1b16-caeb-4c87-a964-4d7f6aaec981 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:31.894781 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3e8e1b16-caeb-4c87-a964-4d7f6aaec981 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:31.895210 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3e8e1b16-caeb-4c87-a964-4d7f6aaec981 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:31.990584 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-d536e168-50ce-4c59-a7cf-109a6caeee7c tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:31.991304 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-d536e168-50ce-4c59-a7cf-109a6caeee7c tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 8d6b5fb0-fd9d-41f2-ae08-3321565c5f39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:31.997961 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d536e168-50ce-4c59-a7cf-109a6caeee7c tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:31.998404 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d536e168-50ce-4c59-a7cf-109a6caeee7c tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:31.999170 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d536e168-50ce-4c59-a7cf-109a6caeee7c tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:31.999602 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d536e168-50ce-4c59-a7cf-109a6caeee7c tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:32.062598 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-3e8e1b16-caeb-4c87-a964-4d7f6aaec981 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:32.071215 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-3e8e1b16-caeb-4c87-a964-4d7f6aaec981 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1548 microversion: 2.1 time: 0.188427 Aug 27 01:36:32.071782 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 534/1018] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:31 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1548 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:36:32.080885 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-3e7c0b25-8f43-4ec0-9741-7c1d6251f1e8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:32.081509 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-3e7c0b25-8f43-4ec0-9741-7c1d6251f1e8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:32.087513 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3e7c0b25-8f43-4ec0-9741-7c1d6251f1e8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:32.088136 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3e7c0b25-8f43-4ec0-9741-7c1d6251f1e8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:32.088731 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3e7c0b25-8f43-4ec0-9741-7c1d6251f1e8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:32.089220 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3e7c0b25-8f43-4ec0-9741-7c1d6251f1e8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:32.131866 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-d536e168-50ce-4c59-a7cf-109a6caeee7c tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:32.139265 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-d536e168-50ce-4c59-a7cf-109a6caeee7c tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39" status: 200 len: 1503 microversion: 2.1 time: 0.152849 Aug 27 01:36:32.139824 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 485/1019] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:31 2021] GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:36:32.145211 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-93b3c1bd-fa7b-4cbc-a3e0-5f63250d428d tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:32.145817 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-93b3c1bd-fa7b-4cbc-a3e0-5f63250d428d tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:32.151803 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-93b3c1bd-fa7b-4cbc-a3e0-5f63250d428d tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:32.152513 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-93b3c1bd-fa7b-4cbc-a3e0-5f63250d428d tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:32.153190 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-93b3c1bd-fa7b-4cbc-a3e0-5f63250d428d tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:32.153624 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-93b3c1bd-fa7b-4cbc-a3e0-5f63250d428d tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:32.287281 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-3e7c0b25-8f43-4ec0-9741-7c1d6251f1e8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:32.293613 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-93b3c1bd-fa7b-4cbc-a3e0-5f63250d428d tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:32.298820 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-3e7c0b25-8f43-4ec0-9741-7c1d6251f1e8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:32.300849 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-3e7c0b25-8f43-4ec0-9741-7c1d6251f1e8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:32.302018 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-3e7c0b25-8f43-4ec0-9741-7c1d6251f1e8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1723 microversion: 2.20 time: 0.229318 Aug 27 01:36:32.302146 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-93b3c1bd-fa7b-4cbc-a3e0-5f63250d428d tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1548 microversion: 2.1 time: 0.161149 Aug 27 01:36:32.302578 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 535/1020] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:36:32 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:36:32.312876 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 486/1021] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:32 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:36:32.318167 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-e40f1750-695b-4a08-aeac-1e8edd521d1e req-b81f32cd-13fe-46bb-9847-aff916f9b59f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d6b5fb0-fd9d-41f2-ae08-3321565c5f39", "name": "network-vif-deleted", "tag": "e2c055ab-51cf-42da-b9db-cd0f000b188e"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:32.318167 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:36:32.318167 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:36:32.318167 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-e40f1750-695b-4a08-aeac-1e8edd521d1e req-b81f32cd-13fe-46bb-9847-aff916f9b59f service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:32.318167 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-e40f1750-695b-4a08-aeac-1e8edd521d1e req-b81f32cd-13fe-46bb-9847-aff916f9b59f service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:32.318636 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-2689af45-0cf0-472e-bae5-a504fe8ee3ea tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:32.322017 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:36:32.322017 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:36:32.323104 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-2689af45-0cf0-472e-bae5-a504fe8ee3ea tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:32.324022 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-2689af45-0cf0-472e-bae5-a504fe8ee3ea tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Searching by: {'deleted': False, 'project_id': '0c906f0891a04908acd7dc34d1953279'} {{(pid=108756) get_all /opt/stack/nova/nova/compute/api.py:2868}} Aug 27 01:36:32.327697 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-e40f1750-695b-4a08-aeac-1e8edd521d1e req-b81f32cd-13fe-46bb-9847-aff916f9b59f service nova] Creating event network-vif-deleted:e2c055ab-51cf-42da-b9db-cd0f000b188e for instance 8d6b5fb0-fd9d-41f2-ae08-3321565c5f39 on hv-cinder-75916 Aug 27 01:36:32.330988 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2689af45-0cf0-472e-bae5-a504fe8ee3ea tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:32.331434 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2689af45-0cf0-472e-bae5-a504fe8ee3ea tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:32.332305 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2689af45-0cf0-472e-bae5-a504fe8ee3ea tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:32.332709 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2689af45-0cf0-472e-bae5-a504fe8ee3ea tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:32.333303 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-e40f1750-695b-4a08-aeac-1e8edd521d1e req-b81f32cd-13fe-46bb-9847-aff916f9b59f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029593 Aug 27 01:36:32.341170 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 536/1022] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:36:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:36:32.425109 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.multi_cell_list [None req-2689af45-0cf0-472e-bae5-a504fe8ee3ea tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=108756) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Aug 27 01:36:32.518872 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-2689af45-0cf0-472e-bae5-a504fe8ee3ea tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204005 Aug 27 01:36:32.519367 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 487/1023] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Aug 27 01:36:32 2021] GET /compute/v2.1/servers => generated 343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:36:32.529745 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4927e3d5-b927-4b9b-b770-bef6e331889e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:32.530427 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4927e3d5-b927-4b9b-b770-bef6e331889e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:32.537077 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4927e3d5-b927-4b9b-b770-bef6e331889e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:32.542012 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4927e3d5-b927-4b9b-b770-bef6e331889e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:32.542012 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4927e3d5-b927-4b9b-b770-bef6e331889e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:32.542012 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4927e3d5-b927-4b9b-b770-bef6e331889e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:32.574519 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-40a4f0e1-8f0c-42d2-a464-e5d2681c9a6f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:32.575427 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-40a4f0e1-8f0c-42d2-a464-e5d2681c9a6f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:32.582428 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-40a4f0e1-8f0c-42d2-a464-e5d2681c9a6f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:32.582923 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-40a4f0e1-8f0c-42d2-a464-e5d2681c9a6f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:32.583690 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-40a4f0e1-8f0c-42d2-a464-e5d2681c9a6f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:32.584180 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-40a4f0e1-8f0c-42d2-a464-e5d2681c9a6f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:32.667088 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4927e3d5-b927-4b9b-b770-bef6e331889e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:32.675109 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4927e3d5-b927-4b9b-b770-bef6e331889e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1548 microversion: 2.1 time: 0.149248 Aug 27 01:36:32.675668 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 537/1024] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:32 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:36:32.677491 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-40a4f0e1-8f0c-42d2-a464-e5d2681c9a6f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 38167 microversion: 2.1 time: 0.106393 Aug 27 01:36:32.678150 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 488/1025] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:36:32 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 38167 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:36:33.156860 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-7e33e27b-248b-4dcf-832b-b78cb36bb2f8 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:33.158451 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-7e33e27b-248b-4dcf-832b-b78cb36bb2f8 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 8d6b5fb0-fd9d-41f2-ae08-3321565c5f39] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:33.164613 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7e33e27b-248b-4dcf-832b-b78cb36bb2f8 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:33.165092 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7e33e27b-248b-4dcf-832b-b78cb36bb2f8 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:33.165860 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7e33e27b-248b-4dcf-832b-b78cb36bb2f8 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:33.166342 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7e33e27b-248b-4dcf-832b-b78cb36bb2f8 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:33.198548 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7e33e27b-248b-4dcf-832b-b78cb36bb2f8 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:33.199215 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7e33e27b-248b-4dcf-832b-b78cb36bb2f8 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:33.199653 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.objects.instance [None req-7e33e27b-248b-4dcf-832b-b78cb36bb2f8 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lazy-loading 'fault' on Instance uuid 8d6b5fb0-fd9d-41f2-ae08-3321565c5f39 {{(pid=108755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:36:33.240275 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-7e33e27b-248b-4dcf-832b-b78cb36bb2f8 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a94d8d27de4c9db7b8f2b1285058ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b47b7bf2ed4568af16eb7861b78453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:33.247505 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-7e33e27b-248b-4dcf-832b-b78cb36bb2f8 tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39" status: 200 len: 1304 microversion: 2.1 time: 0.094545 Aug 27 01:36:33.248069 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 538/1026] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:33 2021] GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:36:33.326541 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-0d13ded2-d34e-4996-812e-6098c407ad4b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:33.326541 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-0d13ded2-d34e-4996-812e-6098c407ad4b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:33.333073 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0d13ded2-d34e-4996-812e-6098c407ad4b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:33.333073 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0d13ded2-d34e-4996-812e-6098c407ad4b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:33.333073 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0d13ded2-d34e-4996-812e-6098c407ad4b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:33.333073 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0d13ded2-d34e-4996-812e-6098c407ad4b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:33.471918 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0d13ded2-d34e-4996-812e-6098c407ad4b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:33.479899 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0d13ded2-d34e-4996-812e-6098c407ad4b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:33.481529 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0d13ded2-d34e-4996-812e-6098c407ad4b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:33.482566 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-0d13ded2-d34e-4996-812e-6098c407ad4b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1723 microversion: 2.20 time: 0.166570 Aug 27 01:36:33.483109 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 489/1027] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:36:33 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:36:33.689809 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b0c2d776-b49f-4b6e-b6ef-8e9bbc5a1f0a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:33.691040 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b0c2d776-b49f-4b6e-b6ef-8e9bbc5a1f0a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:33.697587 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b0c2d776-b49f-4b6e-b6ef-8e9bbc5a1f0a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:33.698033 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b0c2d776-b49f-4b6e-b6ef-8e9bbc5a1f0a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:33.698806 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b0c2d776-b49f-4b6e-b6ef-8e9bbc5a1f0a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:33.699242 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b0c2d776-b49f-4b6e-b6ef-8e9bbc5a1f0a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:33.783561 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b0c2d776-b49f-4b6e-b6ef-8e9bbc5a1f0a tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 38167 microversion: 2.1 time: 0.097726 Aug 27 01:36:33.787300 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 539/1028] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:36:33 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 38167 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:36:34.264667 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-f8dcdb33-ee92-44b0-9b8c-f55faa79ffdc tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:34.265301 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-f8dcdb33-ee92-44b0-9b8c-f55faa79ffdc tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] [instance: 8d6b5fb0-fd9d-41f2-ae08-3321565c5f39] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:34.271859 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f8dcdb33-ee92-44b0-9b8c-f55faa79ffdc tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:34.272287 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f8dcdb33-ee92-44b0-9b8c-f55faa79ffdc tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:34.273083 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f8dcdb33-ee92-44b0-9b8c-f55faa79ffdc tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:34.273515 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f8dcdb33-ee92-44b0-9b8c-f55faa79ffdc tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:34.286675 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.wsgi [None req-f8dcdb33-ee92-44b0-9b8c-f55faa79ffdc tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] HTTP exception thrown: Instance 8d6b5fb0-fd9d-41f2-ae08-3321565c5f39 could not be found. Aug 27 01:36:34.287259 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-f8dcdb33-ee92-44b0-9b8c-f55faa79ffdc tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] Returning 404 to user: Instance 8d6b5fb0-fd9d-41f2-ae08-3321565c5f39 could not be found. {{(pid=108756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:36:34.288095 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-f8dcdb33-ee92-44b0-9b8c-f55faa79ffdc tempest-VolumesActionsTest-1167923959 tempest-VolumesActionsTest-1167923959-project] 10.222.0.25 "GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39" status: 404 len: 111 microversion: 2.1 time: 0.027211 Aug 27 01:36:34.288605 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 490/1029] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:34 2021] GET /compute/v2.1/servers/8d6b5fb0-fd9d-41f2-ae08-3321565c5f39 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:36:34.500590 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-8d0939a6-c0b3-49e0-a677-153067040e4c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:34.502135 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-8d0939a6-c0b3-49e0-a677-153067040e4c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:34.508609 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8d0939a6-c0b3-49e0-a677-153067040e4c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:34.509092 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8d0939a6-c0b3-49e0-a677-153067040e4c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:34.509874 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8d0939a6-c0b3-49e0-a677-153067040e4c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:34.510299 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8d0939a6-c0b3-49e0-a677-153067040e4c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:34.607824 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-89174969-5463-458c-8cde-73b4a02299de tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dfc1a2be-a267-4367-b267-e95712c5c925"}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:34.609794 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-89174969-5463-458c-8cde-73b4a02299de tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:34.616927 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-89174969-5463-458c-8cde-73b4a02299de tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:34.617532 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-89174969-5463-458c-8cde-73b4a02299de tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:34.618431 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-89174969-5463-458c-8cde-73b4a02299de tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:34.618863 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-89174969-5463-458c-8cde-73b4a02299de tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:34.648142 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-8d0939a6-c0b3-49e0-a677-153067040e4c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:34.655989 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-8d0939a6-c0b3-49e0-a677-153067040e4c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:34.658210 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-8d0939a6-c0b3-49e0-a677-153067040e4c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:34.659341 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-8d0939a6-c0b3-49e0-a677-153067040e4c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1723 microversion: 2.20 time: 0.162828 Aug 27 01:36:34.659886 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 540/1030] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:36:34 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:36:34.794480 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-7a25b1af-8679-4fe3-8294-5c87e5f5eb84 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:34.795381 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-7a25b1af-8679-4fe3-8294-5c87e5f5eb84 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:34.802448 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7a25b1af-8679-4fe3-8294-5c87e5f5eb84 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:34.802888 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7a25b1af-8679-4fe3-8294-5c87e5f5eb84 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:34.803647 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7a25b1af-8679-4fe3-8294-5c87e5f5eb84 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:34.804084 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7a25b1af-8679-4fe3-8294-5c87e5f5eb84 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:34.885219 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-7a25b1af-8679-4fe3-8294-5c87e5f5eb84 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 38167 microversion: 2.1 time: 0.094192 Aug 27 01:36:34.889511 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 541/1031] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:36:34 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 38167 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:36:35.476354 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-89174969-5463-458c-8cde-73b4a02299de tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "POST /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.872010 Aug 27 01:36:35.476995 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 491/1032] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Aug 27 01:36:34 2021] POST /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa/os-volume_attachments => generated 194 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:36:35.679692 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-0dd6c8c1-1665-49a2-ac3a-a9b8a8b529ce tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:35.680632 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-0dd6c8c1-1665-49a2-ac3a-a9b8a8b529ce tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:35.687414 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0dd6c8c1-1665-49a2-ac3a-a9b8a8b529ce tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:35.687943 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0dd6c8c1-1665-49a2-ac3a-a9b8a8b529ce tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:35.690027 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0dd6c8c1-1665-49a2-ac3a-a9b8a8b529ce tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:35.690696 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0dd6c8c1-1665-49a2-ac3a-a9b8a8b529ce tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:35.813064 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-0dd6c8c1-1665-49a2-ac3a-a9b8a8b529ce tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:35.821367 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-0dd6c8c1-1665-49a2-ac3a-a9b8a8b529ce tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:35.822867 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-0dd6c8c1-1665-49a2-ac3a-a9b8a8b529ce tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:35.823991 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-0dd6c8c1-1665-49a2-ac3a-a9b8a8b529ce tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1723 microversion: 2.20 time: 0.150026 Aug 27 01:36:35.824537 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 542/1033] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:36:35 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:36:35.897500 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-1d0ac386-578e-4830-b45f-7e2f0db6048f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:35.898485 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-1d0ac386-578e-4830-b45f-7e2f0db6048f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:35.905673 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1d0ac386-578e-4830-b45f-7e2f0db6048f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:35.906123 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1d0ac386-578e-4830-b45f-7e2f0db6048f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:35.906884 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1d0ac386-578e-4830-b45f-7e2f0db6048f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:35.907369 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1d0ac386-578e-4830-b45f-7e2f0db6048f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:36.841900 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-ce47a289-9ee8-47b5-b721-df7eeccaf212 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:36.842414 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-ce47a289-9ee8-47b5-b721-df7eeccaf212 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:36.849362 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ce47a289-9ee8-47b5-b721-df7eeccaf212 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:36.849816 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ce47a289-9ee8-47b5-b721-df7eeccaf212 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:36.850579 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ce47a289-9ee8-47b5-b721-df7eeccaf212 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:36.851010 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ce47a289-9ee8-47b5-b721-df7eeccaf212 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:36.971639 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-ce47a289-9ee8-47b5-b721-df7eeccaf212 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:36.979311 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-ce47a289-9ee8-47b5-b721-df7eeccaf212 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:36.980796 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-ce47a289-9ee8-47b5-b721-df7eeccaf212 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:36.981943 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-ce47a289-9ee8-47b5-b721-df7eeccaf212 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1723 microversion: 2.20 time: 0.143902 Aug 27 01:36:36.982496 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 543/1034] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:36:36 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:36:37.999667 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-7e647c57-3041-4631-919b-7b0c2d631f75 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:38.000276 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-7e647c57-3041-4631-919b-7b0c2d631f75 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:38.006176 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7e647c57-3041-4631-919b-7b0c2d631f75 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:38.006628 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7e647c57-3041-4631-919b-7b0c2d631f75 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:38.007398 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7e647c57-3041-4631-919b-7b0c2d631f75 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:38.007837 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7e647c57-3041-4631-919b-7b0c2d631f75 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:38.129971 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-7e647c57-3041-4631-919b-7b0c2d631f75 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:38.137696 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-7e647c57-3041-4631-919b-7b0c2d631f75 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:38.139190 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-7e647c57-3041-4631-919b-7b0c2d631f75 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:38.140322 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-7e647c57-3041-4631-919b-7b0c2d631f75 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1723 microversion: 2.20 time: 0.144432 Aug 27 01:36:38.140894 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 544/1035] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:36:37 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:36:38.707169 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-1d0ac386-578e-4830-b45f-7e2f0db6048f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action" status: 200 len: 38298 microversion: 2.1 time: 2.813482 Aug 27 01:36:38.707793 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 492/1036] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:36:35 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/action => generated 38298 bytes in 2815 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 01:36:38.717349 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b769af16-bbdb-4988-bd53-0968579a1bdf tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:38.717834 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b769af16-bbdb-4988-bd53-0968579a1bdf tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:38.724136 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b769af16-bbdb-4988-bd53-0968579a1bdf tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:38.724583 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b769af16-bbdb-4988-bd53-0968579a1bdf tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:38.725392 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b769af16-bbdb-4988-bd53-0968579a1bdf tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:38.725833 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b769af16-bbdb-4988-bd53-0968579a1bdf tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:38.749550 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b769af16-bbdb-4988-bd53-0968579a1bdf tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/ips" status: 200 len: 146 microversion: 2.1 time: 0.035826 Aug 27 01:36:38.750115 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 545/1037] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Aug 27 01:36:38 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:36:39.159973 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-049287f8-8323-41b4-aca5-aa6e08381c87 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:39.160687 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-049287f8-8323-41b4-aca5-aa6e08381c87 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:39.167163 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-049287f8-8323-41b4-aca5-aa6e08381c87 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:39.167614 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-049287f8-8323-41b4-aca5-aa6e08381c87 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:39.168380 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-049287f8-8323-41b4-aca5-aa6e08381c87 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:39.168811 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-049287f8-8323-41b4-aca5-aa6e08381c87 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:39.293723 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-049287f8-8323-41b4-aca5-aa6e08381c87 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:39.302014 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-049287f8-8323-41b4-aca5-aa6e08381c87 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:39.303535 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-049287f8-8323-41b4-aca5-aa6e08381c87 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:39.306357 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-049287f8-8323-41b4-aca5-aa6e08381c87 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1723 microversion: 2.20 time: 0.149558 Aug 27 01:36:39.306357 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 493/1038] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:36:39 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:36:40.323636 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-56cbd18a-498b-4f48-afe3-77a34dfcec58 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:40.324183 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-56cbd18a-498b-4f48-afe3-77a34dfcec58 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:40.331403 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-56cbd18a-498b-4f48-afe3-77a34dfcec58 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:40.332048 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-56cbd18a-498b-4f48-afe3-77a34dfcec58 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:40.332850 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-56cbd18a-498b-4f48-afe3-77a34dfcec58 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:40.333307 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-56cbd18a-498b-4f48-afe3-77a34dfcec58 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:40.426696 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-79296855-610d-4e6d-a6f4-614f9dad57ea tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "218790bc-7c9a-4eb7-b04c-f85449ae9ef4"}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:40.428500 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-79296855-610d-4e6d-a6f4-614f9dad57ea tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:40.435446 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-79296855-610d-4e6d-a6f4-614f9dad57ea tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:40.437372 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-79296855-610d-4e6d-a6f4-614f9dad57ea tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:40.437372 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-79296855-610d-4e6d-a6f4-614f9dad57ea tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:40.437827 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-79296855-610d-4e6d-a6f4-614f9dad57ea tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:40.512489 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-56cbd18a-498b-4f48-afe3-77a34dfcec58 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:40.546781 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-56cbd18a-498b-4f48-afe3-77a34dfcec58 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:40.548288 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-56cbd18a-498b-4f48-afe3-77a34dfcec58 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:40.550140 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-56cbd18a-498b-4f48-afe3-77a34dfcec58 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1723 microversion: 2.20 time: 0.230437 Aug 27 01:36:40.551217 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 546/1039] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:36:40 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:36:41.368909 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-79296855-610d-4e6d-a6f4-614f9dad57ea tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.949719 Aug 27 01:36:41.377929 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 494/1040] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Aug 27 01:36:40 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/os-volume_attachments => generated 194 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:36:41.571899 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-f5e41f40-31d0-4ecc-b0aa-5f59aa637f47 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:41.572555 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-f5e41f40-31d0-4ecc-b0aa-5f59aa637f47 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:41.579064 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f5e41f40-31d0-4ecc-b0aa-5f59aa637f47 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:41.579587 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f5e41f40-31d0-4ecc-b0aa-5f59aa637f47 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:41.581099 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f5e41f40-31d0-4ecc-b0aa-5f59aa637f47 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:41.581593 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f5e41f40-31d0-4ecc-b0aa-5f59aa637f47 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:41.719103 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-f5e41f40-31d0-4ecc-b0aa-5f59aa637f47 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:41.728306 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-f5e41f40-31d0-4ecc-b0aa-5f59aa637f47 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:41.729856 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-f5e41f40-31d0-4ecc-b0aa-5f59aa637f47 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:41.731186 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-f5e41f40-31d0-4ecc-b0aa-5f59aa637f47 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1723 microversion: 2.20 time: 0.163182 Aug 27 01:36:41.732941 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 547/1041] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:36:41 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:36:42.753195 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-3257adc6-d57a-4a59-bae5-986431aa5b76 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:42.753981 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-3257adc6-d57a-4a59-bae5-986431aa5b76 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:42.761527 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3257adc6-d57a-4a59-bae5-986431aa5b76 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:42.761974 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3257adc6-d57a-4a59-bae5-986431aa5b76 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:42.762740 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3257adc6-d57a-4a59-bae5-986431aa5b76 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:42.763171 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3257adc6-d57a-4a59-bae5-986431aa5b76 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:42.905697 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-3257adc6-d57a-4a59-bae5-986431aa5b76 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:42.915436 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-3257adc6-d57a-4a59-bae5-986431aa5b76 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:42.917350 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-3257adc6-d57a-4a59-bae5-986431aa5b76 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:42.918936 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-3257adc6-d57a-4a59-bae5-986431aa5b76 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1723 microversion: 2.20 time: 0.170833 Aug 27 01:36:42.930811 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 495/1042] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:36:42 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:36:43.939856 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4ea61964-b311-48d1-a14d-20a32a93b0f1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:43.941302 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4ea61964-b311-48d1-a14d-20a32a93b0f1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:43.949622 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4ea61964-b311-48d1-a14d-20a32a93b0f1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:43.950734 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4ea61964-b311-48d1-a14d-20a32a93b0f1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:43.952228 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4ea61964-b311-48d1-a14d-20a32a93b0f1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:43.952746 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4ea61964-b311-48d1-a14d-20a32a93b0f1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:44.136646 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4ea61964-b311-48d1-a14d-20a32a93b0f1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:44.149125 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4ea61964-b311-48d1-a14d-20a32a93b0f1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:44.151705 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4ea61964-b311-48d1-a14d-20a32a93b0f1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:44.153349 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4ea61964-b311-48d1-a14d-20a32a93b0f1 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1723 microversion: 2.20 time: 0.217518 Aug 27 01:36:44.154822 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 548/1043] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:36:43 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:36:45.172683 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-0403bd13-7293-46bd-a197-2c624410d74e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:45.174072 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-0403bd13-7293-46bd-a197-2c624410d74e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:45.181945 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0403bd13-7293-46bd-a197-2c624410d74e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:45.184916 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0403bd13-7293-46bd-a197-2c624410d74e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:45.184916 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0403bd13-7293-46bd-a197-2c624410d74e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:45.184916 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0403bd13-7293-46bd-a197-2c624410d74e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:45.328865 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0403bd13-7293-46bd-a197-2c624410d74e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:45.338090 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0403bd13-7293-46bd-a197-2c624410d74e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:45.339723 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0403bd13-7293-46bd-a197-2c624410d74e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:45.341153 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-0403bd13-7293-46bd-a197-2c624410d74e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1723 microversion: 2.20 time: 0.172237 Aug 27 01:36:45.341840 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 496/1044] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:36:45 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:36:46.361305 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-472d80ed-a752-4447-bbe8-5e823f5ab5ea tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:46.362070 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-472d80ed-a752-4447-bbe8-5e823f5ab5ea tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:46.369070 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-472d80ed-a752-4447-bbe8-5e823f5ab5ea tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:46.369586 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-472d80ed-a752-4447-bbe8-5e823f5ab5ea tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:46.370594 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-472d80ed-a752-4447-bbe8-5e823f5ab5ea tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:46.371224 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-472d80ed-a752-4447-bbe8-5e823f5ab5ea tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:46.530021 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-472d80ed-a752-4447-bbe8-5e823f5ab5ea tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:46.539223 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-472d80ed-a752-4447-bbe8-5e823f5ab5ea tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:46.541305 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-472d80ed-a752-4447-bbe8-5e823f5ab5ea tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:46.542725 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-472d80ed-a752-4447-bbe8-5e823f5ab5ea tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1723 microversion: 2.20 time: 0.185226 Aug 27 01:36:46.543267 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 549/1045] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:36:46 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:36:47.394751 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-9938e60e-5c1b-4f58-98a8-0e5b23b54612 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:47.395483 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-9938e60e-5c1b-4f58-98a8-0e5b23b54612 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:47.401880 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9938e60e-5c1b-4f58-98a8-0e5b23b54612 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:47.402329 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9938e60e-5c1b-4f58-98a8-0e5b23b54612 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:47.403111 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9938e60e-5c1b-4f58-98a8-0e5b23b54612 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:47.403544 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9938e60e-5c1b-4f58-98a8-0e5b23b54612 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:47.538475 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-9938e60e-5c1b-4f58-98a8-0e5b23b54612 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:47.546824 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-9938e60e-5c1b-4f58-98a8-0e5b23b54612 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1594 microversion: 2.1 time: 0.156631 Aug 27 01:36:47.549993 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 497/1046] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:47 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1594 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:36:47.561692 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-1cc90d3a-fd0b-4dc7-bbd2-fac47a2300d5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:47.562815 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-1cc90d3a-fd0b-4dc7-bbd2-fac47a2300d5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:47.570847 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1cc90d3a-fd0b-4dc7-bbd2-fac47a2300d5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:47.571484 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1cc90d3a-fd0b-4dc7-bbd2-fac47a2300d5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:47.572426 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1cc90d3a-fd0b-4dc7-bbd2-fac47a2300d5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:47.572971 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1cc90d3a-fd0b-4dc7-bbd2-fac47a2300d5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:47.722929 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-1cc90d3a-fd0b-4dc7-bbd2-fac47a2300d5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:47.736782 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-1cc90d3a-fd0b-4dc7-bbd2-fac47a2300d5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:47.738600 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-1cc90d3a-fd0b-4dc7-bbd2-fac47a2300d5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:47.739759 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-1cc90d3a-fd0b-4dc7-bbd2-fac47a2300d5 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1723 microversion: 2.20 time: 0.182713 Aug 27 01:36:47.757255 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 550/1047] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:36:47 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:36:48.757633 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ebe4826f-3783-492b-83f4-16ca7d761e59 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:48.758334 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-ebe4826f-3783-492b-83f4-16ca7d761e59 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:48.764230 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ebe4826f-3783-492b-83f4-16ca7d761e59 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:48.764740 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ebe4826f-3783-492b-83f4-16ca7d761e59 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:48.765611 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ebe4826f-3783-492b-83f4-16ca7d761e59 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:48.766043 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ebe4826f-3783-492b-83f4-16ca7d761e59 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:48.989775 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ebe4826f-3783-492b-83f4-16ca7d761e59 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:49.000235 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ebe4826f-3783-492b-83f4-16ca7d761e59 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:49.006026 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ebe4826f-3783-492b-83f4-16ca7d761e59 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:49.007395 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-ebe4826f-3783-492b-83f4-16ca7d761e59 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1723 microversion: 2.20 time: 0.253461 Aug 27 01:36:49.008126 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 498/1048] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:36:48 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:36:50.028098 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-e8b45b84-cc53-419c-8253-6e145f26c05c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:50.029799 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-e8b45b84-cc53-419c-8253-6e145f26c05c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:50.064893 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e8b45b84-cc53-419c-8253-6e145f26c05c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:50.065453 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e8b45b84-cc53-419c-8253-6e145f26c05c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:50.067400 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e8b45b84-cc53-419c-8253-6e145f26c05c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:50.070012 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e8b45b84-cc53-419c-8253-6e145f26c05c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:50.266043 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-e8b45b84-cc53-419c-8253-6e145f26c05c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:50.293440 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-e2953404-91eb-4567-ab52-09f0832b2ccf req-5ace8438-d035-4e2c-8663-1fcc852607e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05daee4f-8e0c-4b0f-955f-09527893b2fa", "tag": "ecfa3830-4bf2-43df-94c3-c0d06632b36e"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:50.295794 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:36:50.295794 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:36:50.302697 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-e8b45b84-cc53-419c-8253-6e145f26c05c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:50.304760 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-e8b45b84-cc53-419c-8253-6e145f26c05c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:50.313110 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-e8b45b84-cc53-419c-8253-6e145f26c05c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1744 microversion: 2.20 time: 0.283273 Aug 27 01:36:50.313356 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-e2953404-91eb-4567-ab52-09f0832b2ccf req-5ace8438-d035-4e2c-8663-1fcc852607e0 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:50.313356 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-e2953404-91eb-4567-ab52-09f0832b2ccf req-5ace8438-d035-4e2c-8663-1fcc852607e0 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:50.318473 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 551/1049] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:36:50 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1744 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:36:50.322495 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-e2953404-91eb-4567-ab52-09f0832b2ccf req-5ace8438-d035-4e2c-8663-1fcc852607e0 service nova] Creating event network-changed:ecfa3830-4bf2-43df-94c3-c0d06632b36e for instance 05daee4f-8e0c-4b0f-955f-09527893b2fa on hv-cinder-75916 Aug 27 01:36:50.328144 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-e2953404-91eb-4567-ab52-09f0832b2ccf req-5ace8438-d035-4e2c-8663-1fcc852607e0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141190 Aug 27 01:36:50.329293 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 499/1050] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:36:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:36:51.326270 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-e607cc2e-f9ef-489c-877a-9b9011d10eff tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:51.326879 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-e607cc2e-f9ef-489c-877a-9b9011d10eff tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:51.333705 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e607cc2e-f9ef-489c-877a-9b9011d10eff tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:51.334346 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e607cc2e-f9ef-489c-877a-9b9011d10eff tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:51.335446 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e607cc2e-f9ef-489c-877a-9b9011d10eff tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:51.336032 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e607cc2e-f9ef-489c-877a-9b9011d10eff tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:51.514767 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-e607cc2e-f9ef-489c-877a-9b9011d10eff tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:51.528568 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-e607cc2e-f9ef-489c-877a-9b9011d10eff tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:51.538634 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-e607cc2e-f9ef-489c-877a-9b9011d10eff tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:51.538634 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-e607cc2e-f9ef-489c-877a-9b9011d10eff tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1744 microversion: 2.20 time: 0.209607 Aug 27 01:36:51.538634 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 552/1051] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:36:51 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1744 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:36:52.555307 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-0ce79e37-c18b-40a0-9c7f-9c1df07d913b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:52.557032 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-0ce79e37-c18b-40a0-9c7f-9c1df07d913b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:52.570047 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0ce79e37-c18b-40a0-9c7f-9c1df07d913b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:52.571197 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0ce79e37-c18b-40a0-9c7f-9c1df07d913b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:52.577199 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0ce79e37-c18b-40a0-9c7f-9c1df07d913b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:52.577986 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0ce79e37-c18b-40a0-9c7f-9c1df07d913b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:52.834724 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0ce79e37-c18b-40a0-9c7f-9c1df07d913b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:52.847290 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0ce79e37-c18b-40a0-9c7f-9c1df07d913b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:52.849249 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0ce79e37-c18b-40a0-9c7f-9c1df07d913b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:52.852350 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-0ce79e37-c18b-40a0-9c7f-9c1df07d913b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1739 microversion: 2.20 time: 0.305033 Aug 27 01:36:52.853853 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 500/1052] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:36:52 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1739 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:36:53.477399 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-e6026674-f8c8-4378-980b-f94eb9be4e32 req-b44a1190-74c3-4d35-896b-bd4b2690d051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b8f116a-f7c5-4c53-83b6-22034d528599", "name": "network-vif-plugged", "status": "completed", "tag": "39c29f7a-a8f4-47b8-b7f9-8153941ce167"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:53.479587 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:36:53.479587 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:36:53.498880 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-e6026674-f8c8-4378-980b-f94eb9be4e32 req-b44a1190-74c3-4d35-896b-bd4b2690d051 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:53.499610 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-e6026674-f8c8-4378-980b-f94eb9be4e32 req-b44a1190-74c3-4d35-896b-bd4b2690d051 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:53.539884 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-d1a631f4-b8c0-482b-9475-42fcda5f24e2 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2105300849"}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:53.542578 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-d1a631f4-b8c0-482b-9475-42fcda5f24e2 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:53.553953 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-e6026674-f8c8-4378-980b-f94eb9be4e32 req-b44a1190-74c3-4d35-896b-bd4b2690d051 service nova] Creating event network-vif-plugged:39c29f7a-a8f4-47b8-b7f9-8153941ce167 for instance 3b8f116a-f7c5-4c53-83b6-22034d528599 on hv-cinder-75916 Aug 27 01:36:53.570179 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d1a631f4-b8c0-482b-9475-42fcda5f24e2 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:53.573420 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d1a631f4-b8c0-482b-9475-42fcda5f24e2 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:53.574893 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d1a631f4-b8c0-482b-9475-42fcda5f24e2 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:53.578834 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d1a631f4-b8c0-482b-9475-42fcda5f24e2 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:53.581145 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-e6026674-f8c8-4378-980b-f94eb9be4e32 req-b44a1190-74c3-4d35-896b-bd4b2690d051 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103582 Aug 27 01:36:53.583998 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 553/1053] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:36:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:36:53.894202 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-356dd933-d234-45cd-8093-f621d23c89bb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:53.895313 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-356dd933-d234-45cd-8093-f621d23c89bb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:53.963215 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-356dd933-d234-45cd-8093-f621d23c89bb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:53.969500 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-356dd933-d234-45cd-8093-f621d23c89bb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:53.971668 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-356dd933-d234-45cd-8093-f621d23c89bb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:53.981329 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-356dd933-d234-45cd-8093-f621d23c89bb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:54.437040 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-356dd933-d234-45cd-8093-f621d23c89bb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:54.450880 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-356dd933-d234-45cd-8093-f621d23c89bb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:54.464824 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-356dd933-d234-45cd-8093-f621d23c89bb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:54.466248 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-356dd933-d234-45cd-8093-f621d23c89bb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1739 microversion: 2.20 time: 0.579863 Aug 27 01:36:54.467040 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 554/1054] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:36:53 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1739 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:36:54.627989 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.network.security_group_api [None req-d1a631f4-b8c0-482b-9475-42fcda5f24e2 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Adding security group f7df4755-d6ea-4026-bf63-a75d3e9e9361 to port ecfa3830-4bf2-43df-94c3-c0d06632b36e Aug 27 01:36:54.649504 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-fd0c2ffd-16bd-4b43-bcfb-2f9f01356b8e tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:54.651196 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-fd0c2ffd-16bd-4b43-bcfb-2f9f01356b8e tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:54.666687 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fd0c2ffd-16bd-4b43-bcfb-2f9f01356b8e tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:54.667439 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fd0c2ffd-16bd-4b43-bcfb-2f9f01356b8e tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:54.668408 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fd0c2ffd-16bd-4b43-bcfb-2f9f01356b8e tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:54.669050 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fd0c2ffd-16bd-4b43-bcfb-2f9f01356b8e tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:54.743128 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-fd0c2ffd-16bd-4b43-bcfb-2f9f01356b8e tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098464 Aug 27 01:36:54.748883 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 555/1055] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:36:54 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:36:54.759178 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-91130871-a2da-430b-a70c-85e8fbc02293 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:54.759696 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-91130871-a2da-430b-a70c-85e8fbc02293 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:54.777623 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-91130871-a2da-430b-a70c-85e8fbc02293 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:54.780206 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-91130871-a2da-430b-a70c-85e8fbc02293 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:54.781197 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-91130871-a2da-430b-a70c-85e8fbc02293 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:54.781638 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-91130871-a2da-430b-a70c-85e8fbc02293 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:54.856169 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-91130871-a2da-430b-a70c-85e8fbc02293 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/os-volume_attachments/218790bc-7c9a-4eb7-b04c-f85449ae9ef4" status: 200 len: 194 microversion: 2.1 time: 0.100833 Aug 27 01:36:54.858058 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 556/1056] 10.222.0.25 () {58 vars in 1413 bytes} [Fri Aug 27 01:36:54 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/os-volume_attachments/218790bc-7c9a-4eb7-b04c-f85449ae9ef4 => generated 194 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:36:55.361927 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-d1a631f4-b8c0-482b-9475-42fcda5f24e2 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "POST /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa/action" status: 202 len: 0 microversion: 2.1 time: 1.835366 Aug 27 01:36:55.363280 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 501/1057] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:36:53 2021] POST /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa/action => generated 0 bytes in 1842 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:36:55.371291 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-3bc7a0a0-cae4-4e44-a7d0-0b5297e70d19 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:55.372526 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-3bc7a0a0-cae4-4e44-a7d0-0b5297e70d19 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:55.382116 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3bc7a0a0-cae4-4e44-a7d0-0b5297e70d19 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:55.382861 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3bc7a0a0-cae4-4e44-a7d0-0b5297e70d19 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:55.383840 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3bc7a0a0-cae4-4e44-a7d0-0b5297e70d19 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:55.387284 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3bc7a0a0-cae4-4e44-a7d0-0b5297e70d19 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:55.387689 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-62096536-df8c-4129-8c02-8d5662f73764 req-75d8f3e7-a287-43aa-bf53-7df27e8593af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05daee4f-8e0c-4b0f-955f-09527893b2fa", "tag": "ecfa3830-4bf2-43df-94c3-c0d06632b36e"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:55.391301 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:36:55.391301 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:36:55.414387 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-62096536-df8c-4129-8c02-8d5662f73764 req-75d8f3e7-a287-43aa-bf53-7df27e8593af service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:55.420545 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-62096536-df8c-4129-8c02-8d5662f73764 req-75d8f3e7-a287-43aa-bf53-7df27e8593af service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:55.449061 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-62096536-df8c-4129-8c02-8d5662f73764 req-75d8f3e7-a287-43aa-bf53-7df27e8593af service nova] Creating event network-changed:ecfa3830-4bf2-43df-94c3-c0d06632b36e for instance 05daee4f-8e0c-4b0f-955f-09527893b2fa on hv-cinder-75916 Aug 27 01:36:55.457046 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-62096536-df8c-4129-8c02-8d5662f73764 req-75d8f3e7-a287-43aa-bf53-7df27e8593af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074971 Aug 27 01:36:55.459089 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 502/1058] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:36:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:36:55.503634 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-fc099e6f-083e-40a2-a49c-018907bba8e3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:55.512300 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-fc099e6f-083e-40a2-a49c-018907bba8e3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:55.520489 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fc099e6f-083e-40a2-a49c-018907bba8e3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:55.521717 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fc099e6f-083e-40a2-a49c-018907bba8e3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:55.523659 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fc099e6f-083e-40a2-a49c-018907bba8e3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:55.526190 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fc099e6f-083e-40a2-a49c-018907bba8e3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:55.871899 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-3bc7a0a0-cae4-4e44-a7d0-0b5297e70d19 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:55.872454 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-3bc7a0a0-cae4-4e44-a7d0-0b5297e70d19 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1759 microversion: 2.1 time: 0.504194 Aug 27 01:36:55.885981 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 557/1059] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:36:55 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1759 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:36:55.942151 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-fc099e6f-083e-40a2-a49c-018907bba8e3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:55.952679 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-fc099e6f-083e-40a2-a49c-018907bba8e3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:55.955154 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-fc099e6f-083e-40a2-a49c-018907bba8e3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:55.957117 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-fc099e6f-083e-40a2-a49c-018907bba8e3 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1739 microversion: 2.20 time: 0.460247 Aug 27 01:36:55.958250 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 503/1060] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:36:55 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1739 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:36:56.810870 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4e1ceea8-0357-49eb-a5c4-833783066134 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "440ed664-29b7-4f4d-bd99-a492a58c13e6"}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:36:56.812056 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4e1ceea8-0357-49eb-a5c4-833783066134 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:56.818482 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4e1ceea8-0357-49eb-a5c4-833783066134 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:56.818924 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4e1ceea8-0357-49eb-a5c4-833783066134 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:56.819685 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4e1ceea8-0357-49eb-a5c4-833783066134 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:56.820116 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4e1ceea8-0357-49eb-a5c4-833783066134 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:56.978057 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-96c5c191-3d94-4be0-9a0d-c51fbaa236eb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:56.978718 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-96c5c191-3d94-4be0-9a0d-c51fbaa236eb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:56.986132 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-96c5c191-3d94-4be0-9a0d-c51fbaa236eb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:56.987198 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-96c5c191-3d94-4be0-9a0d-c51fbaa236eb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:56.988295 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-96c5c191-3d94-4be0-9a0d-c51fbaa236eb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:56.988732 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-96c5c191-3d94-4be0-9a0d-c51fbaa236eb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:57.196694 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-96c5c191-3d94-4be0-9a0d-c51fbaa236eb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:57.208783 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-96c5c191-3d94-4be0-9a0d-c51fbaa236eb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:57.210794 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-96c5c191-3d94-4be0-9a0d-c51fbaa236eb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:57.212274 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-96c5c191-3d94-4be0-9a0d-c51fbaa236eb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1739 microversion: 2.20 time: 0.238575 Aug 27 01:36:57.224965 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 504/1061] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:36:56 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1739 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:36:57.671966 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4e1ceea8-0357-49eb-a5c4-833783066134 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.849730 Aug 27 01:36:57.675575 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 558/1062] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Aug 27 01:36:56 2021] POST /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/os-volume_attachments => generated 194 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:36:58.230920 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-1dd51314-dfaa-4151-ba1c-8de55da75722 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:58.231481 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-1dd51314-dfaa-4151-ba1c-8de55da75722 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:58.239225 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1dd51314-dfaa-4151-ba1c-8de55da75722 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:58.239667 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1dd51314-dfaa-4151-ba1c-8de55da75722 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:58.240652 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1dd51314-dfaa-4151-ba1c-8de55da75722 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:58.241293 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1dd51314-dfaa-4151-ba1c-8de55da75722 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:58.372634 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-1dd51314-dfaa-4151-ba1c-8de55da75722 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:58.382320 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-1dd51314-dfaa-4151-ba1c-8de55da75722 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:58.384035 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-1dd51314-dfaa-4151-ba1c-8de55da75722 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:58.385204 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-1dd51314-dfaa-4151-ba1c-8de55da75722 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1739 microversion: 2.20 time: 0.158152 Aug 27 01:36:58.386273 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 505/1063] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:36:58 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:36:59.404822 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4293f3a5-43f4-43a8-a0c6-8b744813cb1f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:36:59.407974 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4293f3a5-43f4-43a8-a0c6-8b744813cb1f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:36:59.413875 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4293f3a5-43f4-43a8-a0c6-8b744813cb1f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:59.414659 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4293f3a5-43f4-43a8-a0c6-8b744813cb1f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:59.415991 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4293f3a5-43f4-43a8-a0c6-8b744813cb1f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:36:59.416652 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4293f3a5-43f4-43a8-a0c6-8b744813cb1f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:36:59.582342 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4293f3a5-43f4-43a8-a0c6-8b744813cb1f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:59.597197 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4293f3a5-43f4-43a8-a0c6-8b744813cb1f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:59.598933 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4293f3a5-43f4-43a8-a0c6-8b744813cb1f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:36:59.600147 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4293f3a5-43f4-43a8-a0c6-8b744813cb1f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1739 microversion: 2.20 time: 0.199375 Aug 27 01:36:59.601503 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 559/1064] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:36:59 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:37:00.618656 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-54122af7-43b9-462d-be27-f117570d0a78 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:00.619179 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-54122af7-43b9-462d-be27-f117570d0a78 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:00.625605 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-54122af7-43b9-462d-be27-f117570d0a78 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:00.626115 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-54122af7-43b9-462d-be27-f117570d0a78 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:00.626881 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-54122af7-43b9-462d-be27-f117570d0a78 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:00.627335 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-54122af7-43b9-462d-be27-f117570d0a78 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:00.758700 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-54122af7-43b9-462d-be27-f117570d0a78 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:00.767714 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-54122af7-43b9-462d-be27-f117570d0a78 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:00.769354 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-54122af7-43b9-462d-be27-f117570d0a78 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:00.770689 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-54122af7-43b9-462d-be27-f117570d0a78 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1739 microversion: 2.20 time: 0.156001 Aug 27 01:37:00.771237 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 506/1065] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:00 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:37:01.789886 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-dfea25c4-ae38-4524-8d4d-267b05e4b355 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:01.791239 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-dfea25c4-ae38-4524-8d4d-267b05e4b355 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:01.797703 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-dfea25c4-ae38-4524-8d4d-267b05e4b355 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:01.799251 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-dfea25c4-ae38-4524-8d4d-267b05e4b355 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:01.800318 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-dfea25c4-ae38-4524-8d4d-267b05e4b355 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:01.801035 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-dfea25c4-ae38-4524-8d4d-267b05e4b355 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:01.950739 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-dfea25c4-ae38-4524-8d4d-267b05e4b355 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:01.965527 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-dfea25c4-ae38-4524-8d4d-267b05e4b355 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:01.967527 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-dfea25c4-ae38-4524-8d4d-267b05e4b355 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:01.968651 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-dfea25c4-ae38-4524-8d4d-267b05e4b355 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1739 microversion: 2.20 time: 0.182774 Aug 27 01:37:01.979330 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 560/1066] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:01 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:37:02.989352 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-18e8602e-f11b-4ab2-aba5-ffcbc36ec221 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:02.990096 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-18e8602e-f11b-4ab2-aba5-ffcbc36ec221 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:02.996100 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-18e8602e-f11b-4ab2-aba5-ffcbc36ec221 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:02.997025 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-18e8602e-f11b-4ab2-aba5-ffcbc36ec221 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:03.021540 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-18e8602e-f11b-4ab2-aba5-ffcbc36ec221 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:03.022324 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-18e8602e-f11b-4ab2-aba5-ffcbc36ec221 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:03.209334 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-18e8602e-f11b-4ab2-aba5-ffcbc36ec221 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:03.218019 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-18e8602e-f11b-4ab2-aba5-ffcbc36ec221 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:03.219535 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-18e8602e-f11b-4ab2-aba5-ffcbc36ec221 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:03.221414 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-18e8602e-f11b-4ab2-aba5-ffcbc36ec221 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1739 microversion: 2.20 time: 0.237489 Aug 27 01:37:03.221979 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 507/1067] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:02 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:37:04.246685 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d018b02d-e6b8-4655-895c-b4ec045a15fe tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:04.249730 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d018b02d-e6b8-4655-895c-b4ec045a15fe tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:04.254685 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d018b02d-e6b8-4655-895c-b4ec045a15fe tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:04.255406 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d018b02d-e6b8-4655-895c-b4ec045a15fe tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:04.256435 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d018b02d-e6b8-4655-895c-b4ec045a15fe tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:04.261795 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d018b02d-e6b8-4655-895c-b4ec045a15fe tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:04.442545 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d018b02d-e6b8-4655-895c-b4ec045a15fe tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:04.451724 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d018b02d-e6b8-4655-895c-b4ec045a15fe tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:04.453237 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d018b02d-e6b8-4655-895c-b4ec045a15fe tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:04.454926 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d018b02d-e6b8-4655-895c-b4ec045a15fe tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1739 microversion: 2.20 time: 0.218898 Aug 27 01:37:04.460985 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 561/1068] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:04 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:37:05.473321 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-d40cc03c-6757-4752-a7ac-c622eefc1f89 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:05.473924 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-d40cc03c-6757-4752-a7ac-c622eefc1f89 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:05.479815 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d40cc03c-6757-4752-a7ac-c622eefc1f89 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:05.480262 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d40cc03c-6757-4752-a7ac-c622eefc1f89 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:05.481059 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d40cc03c-6757-4752-a7ac-c622eefc1f89 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:05.481499 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d40cc03c-6757-4752-a7ac-c622eefc1f89 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:05.604262 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-d40cc03c-6757-4752-a7ac-c622eefc1f89 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:05.613037 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-d40cc03c-6757-4752-a7ac-c622eefc1f89 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:05.614528 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-d40cc03c-6757-4752-a7ac-c622eefc1f89 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:05.615662 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-d40cc03c-6757-4752-a7ac-c622eefc1f89 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1739 microversion: 2.20 time: 0.146667 Aug 27 01:37:05.616215 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 508/1069] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:05 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1739 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:37:06.367216 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-a8513001-b3b6-4a35-88cd-2731c898abd1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:06.368263 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-a8513001-b3b6-4a35-88cd-2731c898abd1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:06.374843 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a8513001-b3b6-4a35-88cd-2731c898abd1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:06.375371 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a8513001-b3b6-4a35-88cd-2731c898abd1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:06.377512 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a8513001-b3b6-4a35-88cd-2731c898abd1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:06.378049 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a8513001-b3b6-4a35-88cd-2731c898abd1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:06.410411 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-a8513001-b3b6-4a35-88cd-2731c898abd1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046912 Aug 27 01:37:06.415696 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 562/1070] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:37:06 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:37:06.633724 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-f983816a-e0b6-494b-9c9a-8363344825ed tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:06.634270 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-f983816a-e0b6-494b-9c9a-8363344825ed tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:06.639958 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f983816a-e0b6-494b-9c9a-8363344825ed tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:06.640393 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f983816a-e0b6-494b-9c9a-8363344825ed tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:06.641175 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f983816a-e0b6-494b-9c9a-8363344825ed tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:06.642175 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f983816a-e0b6-494b-9c9a-8363344825ed tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:06.695067 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-aad3b283-32d0-4859-a20f-9ea340a4211b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:06.695548 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-aad3b283-32d0-4859-a20f-9ea340a4211b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:06.701400 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-aad3b283-32d0-4859-a20f-9ea340a4211b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:06.701845 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-aad3b283-32d0-4859-a20f-9ea340a4211b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:06.702607 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-aad3b283-32d0-4859-a20f-9ea340a4211b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:06.703044 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-aad3b283-32d0-4859-a20f-9ea340a4211b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:06.732178 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-aad3b283-32d0-4859-a20f-9ea340a4211b tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/os-volume_attachments/218790bc-7c9a-4eb7-b04c-f85449ae9ef4" status: 200 len: 194 microversion: 2.1 time: 0.040808 Aug 27 01:37:06.732758 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 563/1071] 10.222.0.25 () {58 vars in 1413 bytes} [Fri Aug 27 01:37:06 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/os-volume_attachments/218790bc-7c9a-4eb7-b04c-f85449ae9ef4 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:37:06.741889 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b10fc75c-9766-413d-a274-d4f8c321c390 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:06.742370 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b10fc75c-9766-413d-a274-d4f8c321c390 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:06.747996 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b10fc75c-9766-413d-a274-d4f8c321c390 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:06.748436 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b10fc75c-9766-413d-a274-d4f8c321c390 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:06.749219 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b10fc75c-9766-413d-a274-d4f8c321c390 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:06.749646 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b10fc75c-9766-413d-a274-d4f8c321c390 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:06.766287 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-f983816a-e0b6-494b-9c9a-8363344825ed tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:06.775482 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-f983816a-e0b6-494b-9c9a-8363344825ed tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:06.777153 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-f983816a-e0b6-494b-9c9a-8363344825ed tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:06.778248 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-f983816a-e0b6-494b-9c9a-8363344825ed tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1721 microversion: 2.20 time: 0.148304 Aug 27 01:37:06.778813 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 509/1072] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:06 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:37:06.833745 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.objects.instance [None req-b10fc75c-9766-413d-a274-d4f8c321c390 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lazy-loading 'services' on Instance uuid e4270f24-9903-4782-8633-a676243368a6 {{(pid=108755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:37:07.036455 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b10fc75c-9766-413d-a274-d4f8c321c390 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/os-volume_attachments/218790bc-7c9a-4eb7-b04c-f85449ae9ef4" status: 202 len: 0 microversion: 2.1 time: 0.297851 Aug 27 01:37:07.037354 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 564/1073] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Aug 27 01:37:06 2021] DELETE /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/os-volume_attachments/218790bc-7c9a-4eb7-b04c-f85449ae9ef4 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 01:37:07.797333 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c66edfb8-f8e7-4158-91e9-64248a21d962 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:07.798142 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c66edfb8-f8e7-4158-91e9-64248a21d962 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:07.804066 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c66edfb8-f8e7-4158-91e9-64248a21d962 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:07.804511 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c66edfb8-f8e7-4158-91e9-64248a21d962 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:07.805322 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c66edfb8-f8e7-4158-91e9-64248a21d962 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:07.805809 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c66edfb8-f8e7-4158-91e9-64248a21d962 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:07.923855 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c66edfb8-f8e7-4158-91e9-64248a21d962 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:07.931906 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c66edfb8-f8e7-4158-91e9-64248a21d962 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:07.933416 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c66edfb8-f8e7-4158-91e9-64248a21d962 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:07.936560 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c66edfb8-f8e7-4158-91e9-64248a21d962 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1721 microversion: 2.20 time: 0.141002 Aug 27 01:37:07.936560 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 510/1074] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:07 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1721 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:37:08.953007 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b4748893-7099-4461-a1b3-b9c8a4cb1488 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:08.953693 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b4748893-7099-4461-a1b3-b9c8a4cb1488 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:08.960534 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b4748893-7099-4461-a1b3-b9c8a4cb1488 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:08.961014 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b4748893-7099-4461-a1b3-b9c8a4cb1488 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:08.961786 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b4748893-7099-4461-a1b3-b9c8a4cb1488 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:08.962227 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b4748893-7099-4461-a1b3-b9c8a4cb1488 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:09.088870 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-b4748893-7099-4461-a1b3-b9c8a4cb1488 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:09.097868 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-b4748893-7099-4461-a1b3-b9c8a4cb1488 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:09.101433 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-b4748893-7099-4461-a1b3-b9c8a4cb1488 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:09.101433 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b4748893-7099-4461-a1b3-b9c8a4cb1488 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1724 microversion: 2.20 time: 0.151565 Aug 27 01:37:09.101433 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 565/1075] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:08 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:37:09.118826 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-7a95cf5d-bd50-4332-9b82-6c8899c523a7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc0a28c2-2578-4497-a5da-2903e84b7455"}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:37:09.119865 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-7a95cf5d-bd50-4332-9b82-6c8899c523a7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:09.125699 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7a95cf5d-bd50-4332-9b82-6c8899c523a7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:09.126232 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7a95cf5d-bd50-4332-9b82-6c8899c523a7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:09.127043 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7a95cf5d-bd50-4332-9b82-6c8899c523a7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:09.127480 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7a95cf5d-bd50-4332-9b82-6c8899c523a7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:09.215634 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-a9450353-7dc1-4237-a824-a71f33b5fcd7 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:09.216120 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-a9450353-7dc1-4237-a824-a71f33b5fcd7 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:09.223085 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a9450353-7dc1-4237-a824-a71f33b5fcd7 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:09.223482 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a9450353-7dc1-4237-a824-a71f33b5fcd7 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:09.224430 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a9450353-7dc1-4237-a824-a71f33b5fcd7 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:09.225055 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a9450353-7dc1-4237-a824-a71f33b5fcd7 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:09.255148 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-a9450353-7dc1-4237-a824-a71f33b5fcd7 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/os-volume_attachments/440ed664-29b7-4f4d-bd99-a492a58c13e6" status: 200 len: 194 microversion: 2.1 time: 0.043390 Aug 27 01:37:09.255943 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 566/1076] 10.222.0.25 () {58 vars in 1413 bytes} [Fri Aug 27 01:37:09 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/os-volume_attachments/440ed664-29b7-4f4d-bd99-a492a58c13e6 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:37:09.265649 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d621b9bd-b2d3-432c-aa55-f20a09868bb3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:09.266350 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d621b9bd-b2d3-432c-aa55-f20a09868bb3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:09.274041 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d621b9bd-b2d3-432c-aa55-f20a09868bb3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:09.274486 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d621b9bd-b2d3-432c-aa55-f20a09868bb3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:09.275269 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d621b9bd-b2d3-432c-aa55-f20a09868bb3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:09.276687 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d621b9bd-b2d3-432c-aa55-f20a09868bb3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:09.365977 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.objects.instance [None req-d621b9bd-b2d3-432c-aa55-f20a09868bb3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lazy-loading 'services' on Instance uuid e4270f24-9903-4782-8633-a676243368a6 {{(pid=108755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:37:09.602715 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d621b9bd-b2d3-432c-aa55-f20a09868bb3 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/os-volume_attachments/440ed664-29b7-4f4d-bd99-a492a58c13e6" status: 202 len: 0 microversion: 2.1 time: 0.340507 Aug 27 01:37:09.603590 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 567/1077] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Aug 27 01:37:09 2021] DELETE /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/os-volume_attachments/440ed664-29b7-4f4d-bd99-a492a58c13e6 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:37:09.612160 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-8339cd74-498f-4d97-94ff-fa541646a583 req-dee10be1-750a-4ea3-951d-43d4502e28fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b8f116a-f7c5-4c53-83b6-22034d528599", "name": "network-vif-unplugged", "status": "completed", "tag": "39c29f7a-a8f4-47b8-b7f9-8153941ce167"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:37:09.613767 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:37:09.613767 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:37:09.620826 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-8339cd74-498f-4d97-94ff-fa541646a583 req-dee10be1-750a-4ea3-951d-43d4502e28fb service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:09.625528 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-8339cd74-498f-4d97-94ff-fa541646a583 req-dee10be1-750a-4ea3-951d-43d4502e28fb service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:09.633483 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.compute.server_external_events [req-8339cd74-498f-4d97-94ff-fa541646a583 req-dee10be1-750a-4ea3-951d-43d4502e28fb service nova] Unable to find a host for instance 3b8f116a-f7c5-4c53-83b6-22034d528599. Dropping event network-vif-unplugged {{(pid=108755) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Aug 27 01:37:09.634404 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-8339cd74-498f-4d97-94ff-fa541646a583 req-dee10be1-750a-4ea3-951d-43d4502e28fb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026587 Aug 27 01:37:09.634987 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 568/1078] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:37:09 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 27 01:37:09.822667 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-e4fcf5b0-4ebf-4a54-aee0-59a743e1346e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:37:09.823730 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-e4fcf5b0-4ebf-4a54-aee0-59a743e1346e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:09.830435 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e4fcf5b0-4ebf-4a54-aee0-59a743e1346e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:09.830871 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e4fcf5b0-4ebf-4a54-aee0-59a743e1346e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:09.831620 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e4fcf5b0-4ebf-4a54-aee0-59a743e1346e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:09.832065 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e4fcf5b0-4ebf-4a54-aee0-59a743e1346e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:10.023665 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-e4fcf5b0-4ebf-4a54-aee0-59a743e1346e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "POST /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa/action" status: 202 len: 0 microversion: 2.1 time: 0.204703 Aug 27 01:37:10.024283 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 569/1079] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:37:09 2021] POST /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 01:37:10.033244 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-e0421671-bc86-4857-ad0e-14607aa2bdb6 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:10.035196 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-e0421671-bc86-4857-ad0e-14607aa2bdb6 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:10.041359 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e0421671-bc86-4857-ad0e-14607aa2bdb6 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:10.041805 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e0421671-bc86-4857-ad0e-14607aa2bdb6 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:10.042574 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e0421671-bc86-4857-ad0e-14607aa2bdb6 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:10.043005 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e0421671-bc86-4857-ad0e-14607aa2bdb6 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:10.162280 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-7a95cf5d-bd50-4332-9b82-6c8899c523a7 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.047444 Aug 27 01:37:10.163375 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 511/1080] 10.222.0.25 () {62 vars in 1364 bytes} [Fri Aug 27 01:37:09 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/os-volume_attachments => generated 188 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 01:37:10.169113 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-e0421671-bc86-4857-ad0e-14607aa2bdb6 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:10.179680 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-e0421671-bc86-4857-ad0e-14607aa2bdb6 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1751 microversion: 2.1 time: 0.151218 Aug 27 01:37:10.184476 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 570/1081] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:10 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:37:10.310531 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-8a363bae-2321-485c-8d22-8a4567912656 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:10.312610 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-8a363bae-2321-485c-8d22-8a4567912656 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:10.317285 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8a363bae-2321-485c-8d22-8a4567912656 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:10.317731 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8a363bae-2321-485c-8d22-8a4567912656 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:10.318532 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8a363bae-2321-485c-8d22-8a4567912656 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:10.318961 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8a363bae-2321-485c-8d22-8a4567912656 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:10.784856 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4ab9f25a-49cf-4163-814e-e93a5e05bc54 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:10.785791 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4ab9f25a-49cf-4163-814e-e93a5e05bc54 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:10.791663 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4ab9f25a-49cf-4163-814e-e93a5e05bc54 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:10.792113 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4ab9f25a-49cf-4163-814e-e93a5e05bc54 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:10.792936 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4ab9f25a-49cf-4163-814e-e93a5e05bc54 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:10.793376 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4ab9f25a-49cf-4163-814e-e93a5e05bc54 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:10.822256 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4ab9f25a-49cf-4163-814e-e93a5e05bc54 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042162 Aug 27 01:37:10.823165 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 571/1082] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:37:10 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 01:37:10.942347 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-6479b6e1-c7f8-4d6c-bb09-8cd77effe3f2 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:10.943294 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-6479b6e1-c7f8-4d6c-bb09-8cd77effe3f2 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:10.949249 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6479b6e1-c7f8-4d6c-bb09-8cd77effe3f2 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:10.949732 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6479b6e1-c7f8-4d6c-bb09-8cd77effe3f2 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:10.952045 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6479b6e1-c7f8-4d6c-bb09-8cd77effe3f2 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:10.952045 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6479b6e1-c7f8-4d6c-bb09-8cd77effe3f2 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:10.981399 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-6479b6e1-c7f8-4d6c-bb09-8cd77effe3f2 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042830 Aug 27 01:37:10.981944 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 572/1083] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:37:10 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 01:37:11.007979 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-8a363bae-2321-485c-8d22-8a4567912656 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/os-volume_attachments/cc0a28c2-2578-4497-a5da-2903e84b7455" status: 202 len: 0 microversion: 2.20 time: 0.706505 Aug 27 01:37:11.008650 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 512/1084] 10.222.0.25 () {60 vars in 1457 bytes} [Fri Aug 27 01:37:10 2021] DELETE /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/os-volume_attachments/cc0a28c2-2578-4497-a5da-2903e84b7455 => generated 0 bytes in 708 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 01:37:11.044521 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-653c49e3-fd79-4ca8-92db-024e9aebbe22 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:11.045034 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-653c49e3-fd79-4ca8-92db-024e9aebbe22 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:11.051258 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-653c49e3-fd79-4ca8-92db-024e9aebbe22 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:11.051698 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-653c49e3-fd79-4ca8-92db-024e9aebbe22 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:11.052447 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-653c49e3-fd79-4ca8-92db-024e9aebbe22 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:11.052991 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-653c49e3-fd79-4ca8-92db-024e9aebbe22 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:11.069732 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-beaa857a-5ec4-4017-b845-b0aa2662fe50 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:37:11.070297 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-beaa857a-5ec4-4017-b845-b0aa2662fe50 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:11.075860 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-beaa857a-5ec4-4017-b845-b0aa2662fe50 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:11.076319 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-beaa857a-5ec4-4017-b845-b0aa2662fe50 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:11.077109 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-beaa857a-5ec4-4017-b845-b0aa2662fe50 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:11.077541 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-beaa857a-5ec4-4017-b845-b0aa2662fe50 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:11.082328 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-653c49e3-fd79-4ca8-92db-024e9aebbe22 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Going to try to terminate instance {{(pid=108755) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 01:37:11.303854 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-beaa857a-5ec4-4017-b845-b0aa2662fe50 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action" status: 202 len: 0 microversion: 2.20 time: 0.237420 Aug 27 01:37:11.304387 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 513/1085] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Aug 27 01:37:11 2021] POST /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 27 01:37:11.308713 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-5036605a-5767-4524-ba5d-431f0f00ae06 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:11.309407 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-5036605a-5767-4524-ba5d-431f0f00ae06 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:11.315706 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5036605a-5767-4524-ba5d-431f0f00ae06 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:11.316197 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5036605a-5767-4524-ba5d-431f0f00ae06 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:11.317006 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5036605a-5767-4524-ba5d-431f0f00ae06 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:11.317450 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5036605a-5767-4524-ba5d-431f0f00ae06 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:11.380170 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-653c49e3-fd79-4ca8-92db-024e9aebbe22 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 204 len: 0 microversion: 2.1 time: 0.338932 Aug 27 01:37:11.380761 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 573/1086] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Aug 27 01:37:11 2021] DELETE /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 01:37:11.385972 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d704755c-d16d-4c70-b25f-04f68f89d6fe tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:11.386668 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d704755c-d16d-4c70-b25f-04f68f89d6fe tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:11.392856 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d704755c-d16d-4c70-b25f-04f68f89d6fe tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:11.393068 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d704755c-d16d-4c70-b25f-04f68f89d6fe tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:11.393793 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d704755c-d16d-4c70-b25f-04f68f89d6fe tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:11.394228 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d704755c-d16d-4c70-b25f-04f68f89d6fe tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:11.453597 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-5036605a-5767-4524-ba5d-431f0f00ae06 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:11.462372 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-5036605a-5767-4524-ba5d-431f0f00ae06 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1756 microversion: 2.1 time: 0.156970 Aug 27 01:37:11.462934 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 514/1087] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:11 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1756 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:37:11.467108 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-3599ae6a-6f40-4d10-ba26-afb1c856d106 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:11.467876 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-3599ae6a-6f40-4d10-ba26-afb1c856d106 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:11.475250 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3599ae6a-6f40-4d10-ba26-afb1c856d106 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:11.475906 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3599ae6a-6f40-4d10-ba26-afb1c856d106 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:11.476692 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3599ae6a-6f40-4d10-ba26-afb1c856d106 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:11.477136 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3599ae6a-6f40-4d10-ba26-afb1c856d106 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:11.529841 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d704755c-d16d-4c70-b25f-04f68f89d6fe tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:11.541806 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d704755c-d16d-4c70-b25f-04f68f89d6fe tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:11.543927 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d704755c-d16d-4c70-b25f-04f68f89d6fe tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:11.548339 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d704755c-d16d-4c70-b25f-04f68f89d6fe tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1672 microversion: 2.20 time: 0.165812 Aug 27 01:37:11.549812 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 574/1088] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:11 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:37:11.614071 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-3599ae6a-6f40-4d10-ba26-afb1c856d106 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:11.621680 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-3599ae6a-6f40-4d10-ba26-afb1c856d106 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 200 len: 1675 microversion: 2.1 time: 0.157748 Aug 27 01:37:11.622361 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 515/1089] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:11 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:37:12.481163 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-a5d2dfb9-c600-477c-b5ee-17b156a0f7a2 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:12.481693 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-a5d2dfb9-c600-477c-b5ee-17b156a0f7a2 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:12.488092 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a5d2dfb9-c600-477c-b5ee-17b156a0f7a2 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:12.488532 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a5d2dfb9-c600-477c-b5ee-17b156a0f7a2 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:12.489380 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a5d2dfb9-c600-477c-b5ee-17b156a0f7a2 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:12.489805 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a5d2dfb9-c600-477c-b5ee-17b156a0f7a2 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:12.568783 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-37943922-1259-4c93-be6c-f36cf6db7dd0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:12.569412 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-37943922-1259-4c93-be6c-f36cf6db7dd0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:12.575511 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-37943922-1259-4c93-be6c-f36cf6db7dd0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:12.575954 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-37943922-1259-4c93-be6c-f36cf6db7dd0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:12.576802 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-37943922-1259-4c93-be6c-f36cf6db7dd0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:12.577257 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-37943922-1259-4c93-be6c-f36cf6db7dd0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:12.619184 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-a5d2dfb9-c600-477c-b5ee-17b156a0f7a2 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:12.632852 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-a5d2dfb9-c600-477c-b5ee-17b156a0f7a2 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1756 microversion: 2.1 time: 0.156533 Aug 27 01:37:12.634028 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 575/1090] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:12 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1756 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:37:12.641162 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-fe08bf17-0656-4446-a862-6b93fb860c81 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:12.642184 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-fe08bf17-0656-4446-a862-6b93fb860c81 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:12.648154 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fe08bf17-0656-4446-a862-6b93fb860c81 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:12.648872 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fe08bf17-0656-4446-a862-6b93fb860c81 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:12.649661 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fe08bf17-0656-4446-a862-6b93fb860c81 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:12.650078 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fe08bf17-0656-4446-a862-6b93fb860c81 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:12.708583 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-37943922-1259-4c93-be6c-f36cf6db7dd0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:12.716785 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-37943922-1259-4c93-be6c-f36cf6db7dd0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:12.721518 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-37943922-1259-4c93-be6c-f36cf6db7dd0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:12.722885 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-37943922-1259-4c93-be6c-f36cf6db7dd0 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1672 microversion: 2.20 time: 0.158312 Aug 27 01:37:12.727820 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 516/1091] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:12 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:37:13.012860 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-fe08bf17-0656-4446-a862-6b93fb860c81 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:13.020810 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-fe08bf17-0656-4446-a862-6b93fb860c81 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 200 len: 1675 microversion: 2.1 time: 0.384812 Aug 27 01:37:13.021384 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 576/1092] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:12 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 1675 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:37:13.650020 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-05a3d825-d524-4b6b-9262-4cb7fd0212ac tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:13.650775 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-05a3d825-d524-4b6b-9262-4cb7fd0212ac tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:13.656649 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-05a3d825-d524-4b6b-9262-4cb7fd0212ac tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:13.657244 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-05a3d825-d524-4b6b-9262-4cb7fd0212ac tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:13.658273 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-05a3d825-d524-4b6b-9262-4cb7fd0212ac tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:13.658728 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-05a3d825-d524-4b6b-9262-4cb7fd0212ac tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:13.743177 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-6f177c30-9e2a-4dbf-9b59-891ca484fe6f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:13.744810 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-6f177c30-9e2a-4dbf-9b59-891ca484fe6f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:13.751337 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6f177c30-9e2a-4dbf-9b59-891ca484fe6f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:13.751784 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6f177c30-9e2a-4dbf-9b59-891ca484fe6f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:13.752570 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6f177c30-9e2a-4dbf-9b59-891ca484fe6f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:13.753013 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6f177c30-9e2a-4dbf-9b59-891ca484fe6f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:13.789687 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-05a3d825-d524-4b6b-9262-4cb7fd0212ac tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:13.799924 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-05a3d825-d524-4b6b-9262-4cb7fd0212ac tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1756 microversion: 2.1 time: 0.153469 Aug 27 01:37:13.812055 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 517/1093] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:13 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:37:14.038418 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ac32b794-7cbc-4191-b7e2-972bd5195f28 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:14.039021 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-ac32b794-7cbc-4191-b7e2-972bd5195f28 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:14.044772 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ac32b794-7cbc-4191-b7e2-972bd5195f28 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:14.045302 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ac32b794-7cbc-4191-b7e2-972bd5195f28 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:14.046172 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ac32b794-7cbc-4191-b7e2-972bd5195f28 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:14.046601 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ac32b794-7cbc-4191-b7e2-972bd5195f28 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:14.113552 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-6f177c30-9e2a-4dbf-9b59-891ca484fe6f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:14.126252 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-6f177c30-9e2a-4dbf-9b59-891ca484fe6f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:14.133222 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-6f177c30-9e2a-4dbf-9b59-891ca484fe6f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:14.134420 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-6f177c30-9e2a-4dbf-9b59-891ca484fe6f tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1730 microversion: 2.20 time: 0.396939 Aug 27 01:37:14.134986 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 577/1094] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:13 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1730 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:37:14.191066 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ac32b794-7cbc-4191-b7e2-972bd5195f28 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:14.191314 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-ac32b794-7cbc-4191-b7e2-972bd5195f28 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 200 len: 1675 microversion: 2.1 time: 0.156574 Aug 27 01:37:14.191887 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 518/1095] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:14 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:37:14.818618 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-62ef7040-5b82-43ad-9099-1e486c6ee66c tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:14.819370 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-62ef7040-5b82-43ad-9099-1e486c6ee66c tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:14.827405 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-62ef7040-5b82-43ad-9099-1e486c6ee66c tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:14.827953 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-62ef7040-5b82-43ad-9099-1e486c6ee66c tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:14.828946 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-62ef7040-5b82-43ad-9099-1e486c6ee66c tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:14.829619 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-62ef7040-5b82-43ad-9099-1e486c6ee66c tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:14.944357 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-923eb9f1-f7ed-4ba9-9f11-748d94500665 req-ebcb262c-828d-4e61-b07a-6faa024e43e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4270f24-9903-4782-8633-a676243368a6", "name": "network-vif-deleted", "tag": "043fb403-1255-4b2f-94a3-72fd35ade4a5"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:37:14.946753 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:37:14.946753 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:37:14.956803 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-923eb9f1-f7ed-4ba9-9f11-748d94500665 req-ebcb262c-828d-4e61-b07a-6faa024e43e2 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:14.958108 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-923eb9f1-f7ed-4ba9-9f11-748d94500665 req-ebcb262c-828d-4e61-b07a-6faa024e43e2 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:14.973192 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-923eb9f1-f7ed-4ba9-9f11-748d94500665 req-ebcb262c-828d-4e61-b07a-6faa024e43e2 service nova] Creating event network-vif-deleted:043fb403-1255-4b2f-94a3-72fd35ade4a5 for instance e4270f24-9903-4782-8633-a676243368a6 on hv-cinder-75916 Aug 27 01:37:14.979862 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-923eb9f1-f7ed-4ba9-9f11-748d94500665 req-ebcb262c-828d-4e61-b07a-6faa024e43e2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051608 Aug 27 01:37:14.981167 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 519/1096] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:37:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:37:15.039705 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-62ef7040-5b82-43ad-9099-1e486c6ee66c tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:15.049759 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-62ef7040-5b82-43ad-9099-1e486c6ee66c tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1756 microversion: 2.1 time: 0.235275 Aug 27 01:37:15.050448 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 578/1097] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:14 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1756 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:37:15.154242 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-09278f8a-3372-409c-9c43-23ab263ec414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:15.154936 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-09278f8a-3372-409c-9c43-23ab263ec414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:15.161544 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-09278f8a-3372-409c-9c43-23ab263ec414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:15.163197 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-09278f8a-3372-409c-9c43-23ab263ec414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:15.164002 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-09278f8a-3372-409c-9c43-23ab263ec414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:15.164436 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-09278f8a-3372-409c-9c43-23ab263ec414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:15.208321 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d4d8d37d-28b6-4f04-a421-bd2f7e697c09 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:15.210913 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d4d8d37d-28b6-4f04-a421-bd2f7e697c09 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:15.215839 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d4d8d37d-28b6-4f04-a421-bd2f7e697c09 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:15.216387 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d4d8d37d-28b6-4f04-a421-bd2f7e697c09 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:15.217323 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d4d8d37d-28b6-4f04-a421-bd2f7e697c09 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:15.218000 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d4d8d37d-28b6-4f04-a421-bd2f7e697c09 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:15.288491 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d4d8d37d-28b6-4f04-a421-bd2f7e697c09 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:15.296796 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d4d8d37d-28b6-4f04-a421-bd2f7e697c09 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 200 len: 1607 microversion: 2.1 time: 0.092421 Aug 27 01:37:15.306954 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 579/1098] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:15 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 1607 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:37:15.318376 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-09278f8a-3372-409c-9c43-23ab263ec414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:15.326218 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-09278f8a-3372-409c-9c43-23ab263ec414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:15.327710 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-09278f8a-3372-409c-9c43-23ab263ec414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:15.329385 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-09278f8a-3372-409c-9c43-23ab263ec414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1730 microversion: 2.20 time: 0.179195 Aug 27 01:37:15.329944 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 520/1099] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:15 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:37:16.067323 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-945bb555-324d-4c08-b158-127dc97fa0ee tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:16.067958 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-945bb555-324d-4c08-b158-127dc97fa0ee tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:16.074118 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-945bb555-324d-4c08-b158-127dc97fa0ee tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:16.074590 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-945bb555-324d-4c08-b158-127dc97fa0ee tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:16.075348 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-945bb555-324d-4c08-b158-127dc97fa0ee tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:16.075792 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-945bb555-324d-4c08-b158-127dc97fa0ee tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:16.197593 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-945bb555-324d-4c08-b158-127dc97fa0ee tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:16.205738 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-945bb555-324d-4c08-b158-127dc97fa0ee tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1756 microversion: 2.1 time: 0.142076 Aug 27 01:37:16.206300 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 580/1100] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:16 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1756 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:37:16.314619 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ade12ab5-9833-4ced-9e89-be371dea8635 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:16.315243 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-ade12ab5-9833-4ced-9e89-be371dea8635 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:16.321375 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ade12ab5-9833-4ced-9e89-be371dea8635 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:16.325832 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ade12ab5-9833-4ced-9e89-be371dea8635 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:16.325832 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ade12ab5-9833-4ced-9e89-be371dea8635 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:16.325832 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ade12ab5-9833-4ced-9e89-be371dea8635 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:16.347568 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-cb69b8df-bbeb-43e2-8310-c30c84dda3bd tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:16.348310 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-cb69b8df-bbeb-43e2-8310-c30c84dda3bd tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:16.354403 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-cb69b8df-bbeb-43e2-8310-c30c84dda3bd tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:16.354868 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-cb69b8df-bbeb-43e2-8310-c30c84dda3bd tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:16.355631 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-cb69b8df-bbeb-43e2-8310-c30c84dda3bd tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:16.356066 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-cb69b8df-bbeb-43e2-8310-c30c84dda3bd tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:16.386747 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ade12ab5-9833-4ced-9e89-be371dea8635 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:16.395101 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-ade12ab5-9833-4ced-9e89-be371dea8635 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 200 len: 1607 microversion: 2.1 time: 0.084520 Aug 27 01:37:16.401060 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 521/1101] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:16 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 1607 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:37:16.478197 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-cb69b8df-bbeb-43e2-8310-c30c84dda3bd tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:16.485949 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-cb69b8df-bbeb-43e2-8310-c30c84dda3bd tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:16.487488 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-cb69b8df-bbeb-43e2-8310-c30c84dda3bd tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:16.488606 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-cb69b8df-bbeb-43e2-8310-c30c84dda3bd tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1730 microversion: 2.20 time: 0.145351 Aug 27 01:37:16.489186 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 581/1102] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:16 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1730 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:37:17.223653 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-96a9805d-f005-4c06-973b-8b9fa1630e01 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:17.224265 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-96a9805d-f005-4c06-973b-8b9fa1630e01 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:17.230176 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-96a9805d-f005-4c06-973b-8b9fa1630e01 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:17.231883 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-96a9805d-f005-4c06-973b-8b9fa1630e01 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:17.231883 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-96a9805d-f005-4c06-973b-8b9fa1630e01 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:17.231883 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-96a9805d-f005-4c06-973b-8b9fa1630e01 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:17.358968 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-96a9805d-f005-4c06-973b-8b9fa1630e01 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:17.367962 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-96a9805d-f005-4c06-973b-8b9fa1630e01 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1756 microversion: 2.1 time: 0.148756 Aug 27 01:37:17.378290 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 522/1103] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:17 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1756 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:37:17.411266 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4828ab55-6be5-44bc-8baa-bf5f607f3272 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:17.411913 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4828ab55-6be5-44bc-8baa-bf5f607f3272 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:17.417975 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4828ab55-6be5-44bc-8baa-bf5f607f3272 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:17.418244 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4828ab55-6be5-44bc-8baa-bf5f607f3272 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:17.419011 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4828ab55-6be5-44bc-8baa-bf5f607f3272 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:17.419698 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4828ab55-6be5-44bc-8baa-bf5f607f3272 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:17.484261 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4828ab55-6be5-44bc-8baa-bf5f607f3272 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:17.491784 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4828ab55-6be5-44bc-8baa-bf5f607f3272 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 200 len: 1323 microversion: 2.1 time: 0.084196 Aug 27 01:37:17.492356 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 582/1104] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:17 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 1323 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:37:17.506444 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-0a67e5f1-08e8-475a-9f88-39f19f1fbb3b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:17.507055 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-0a67e5f1-08e8-475a-9f88-39f19f1fbb3b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:17.512734 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0a67e5f1-08e8-475a-9f88-39f19f1fbb3b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:17.513212 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0a67e5f1-08e8-475a-9f88-39f19f1fbb3b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:17.513986 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0a67e5f1-08e8-475a-9f88-39f19f1fbb3b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:17.514415 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0a67e5f1-08e8-475a-9f88-39f19f1fbb3b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:17.649112 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0a67e5f1-08e8-475a-9f88-39f19f1fbb3b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:17.657525 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0a67e5f1-08e8-475a-9f88-39f19f1fbb3b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:17.663578 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0a67e5f1-08e8-475a-9f88-39f19f1fbb3b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:17.663578 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-0a67e5f1-08e8-475a-9f88-39f19f1fbb3b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1730 microversion: 2.20 time: 0.157384 Aug 27 01:37:17.663578 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 523/1105] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:17 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:37:18.384689 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-3d9ef1fd-f305-4a2a-b012-ba8b18f642fb tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:18.385335 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-3d9ef1fd-f305-4a2a-b012-ba8b18f642fb tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:18.392782 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3d9ef1fd-f305-4a2a-b012-ba8b18f642fb tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:18.393284 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3d9ef1fd-f305-4a2a-b012-ba8b18f642fb tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:18.394072 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3d9ef1fd-f305-4a2a-b012-ba8b18f642fb tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:18.394518 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3d9ef1fd-f305-4a2a-b012-ba8b18f642fb tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:18.508341 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-7e149518-c2b3-4390-b783-baf984d55458 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:18.509686 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-7e149518-c2b3-4390-b783-baf984d55458 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:18.518606 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7e149518-c2b3-4390-b783-baf984d55458 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:18.519314 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7e149518-c2b3-4390-b783-baf984d55458 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:18.525768 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7e149518-c2b3-4390-b783-baf984d55458 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:18.526439 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7e149518-c2b3-4390-b783-baf984d55458 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:18.573162 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-3d9ef1fd-f305-4a2a-b012-ba8b18f642fb tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:18.580981 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7e149518-c2b3-4390-b783-baf984d55458 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:18.581431 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7e149518-c2b3-4390-b783-baf984d55458 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:18.581888 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.objects.instance [None req-7e149518-c2b3-4390-b783-baf984d55458 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lazy-loading 'fault' on Instance uuid e4270f24-9903-4782-8633-a676243368a6 {{(pid=108756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:37:18.583108 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-3d9ef1fd-f305-4a2a-b012-ba8b18f642fb tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1756 microversion: 2.1 time: 0.201841 Aug 27 01:37:18.583704 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 583/1106] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:18 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1756 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:37:18.625407 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-7e149518-c2b3-4390-b783-baf984d55458 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:18.635834 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-7e149518-c2b3-4390-b783-baf984d55458 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 200 len: 1328 microversion: 2.1 time: 0.130952 Aug 27 01:37:18.637031 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 524/1107] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:18 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 1328 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:37:18.678524 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-7bc426eb-450a-42cb-88ea-90b1914ca414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:18.679129 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-7bc426eb-450a-42cb-88ea-90b1914ca414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:18.685095 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7bc426eb-450a-42cb-88ea-90b1914ca414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:18.685539 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7bc426eb-450a-42cb-88ea-90b1914ca414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:18.686291 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7bc426eb-450a-42cb-88ea-90b1914ca414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:18.687059 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7bc426eb-450a-42cb-88ea-90b1914ca414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:18.825850 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-7bc426eb-450a-42cb-88ea-90b1914ca414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:18.835293 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-7bc426eb-450a-42cb-88ea-90b1914ca414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:18.837320 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-7bc426eb-450a-42cb-88ea-90b1914ca414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:18.838468 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-7bc426eb-450a-42cb-88ea-90b1914ca414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1730 microversion: 2.20 time: 0.163888 Aug 27 01:37:18.839027 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 584/1108] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:18 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:37:19.600005 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-1892c4bc-c6e2-4ef7-8fde-85d3cf6c3b29 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:19.600866 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-1892c4bc-c6e2-4ef7-8fde-85d3cf6c3b29 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:19.606858 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1892c4bc-c6e2-4ef7-8fde-85d3cf6c3b29 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:19.607348 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1892c4bc-c6e2-4ef7-8fde-85d3cf6c3b29 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:19.611438 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1892c4bc-c6e2-4ef7-8fde-85d3cf6c3b29 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:19.611438 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1892c4bc-c6e2-4ef7-8fde-85d3cf6c3b29 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:19.654139 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-81b2026d-51c7-48dd-b214-5e8edf2523bf tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:19.654931 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-81b2026d-51c7-48dd-b214-5e8edf2523bf tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:19.661835 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-81b2026d-51c7-48dd-b214-5e8edf2523bf tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:19.662422 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-81b2026d-51c7-48dd-b214-5e8edf2523bf tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:19.663317 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-81b2026d-51c7-48dd-b214-5e8edf2523bf tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:19.663861 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-81b2026d-51c7-48dd-b214-5e8edf2523bf tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:19.699411 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-81b2026d-51c7-48dd-b214-5e8edf2523bf tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:19.700200 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-81b2026d-51c7-48dd-b214-5e8edf2523bf tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:19.701092 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.objects.instance [None req-81b2026d-51c7-48dd-b214-5e8edf2523bf tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lazy-loading 'fault' on Instance uuid e4270f24-9903-4782-8633-a676243368a6 {{(pid=108755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:37:19.743813 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-81b2026d-51c7-48dd-b214-5e8edf2523bf tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:19.753114 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-81b2026d-51c7-48dd-b214-5e8edf2523bf tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 200 len: 1328 microversion: 2.1 time: 0.102522 Aug 27 01:37:19.754032 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 585/1109] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:19 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 1328 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:37:19.762693 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-1892c4bc-c6e2-4ef7-8fde-85d3cf6c3b29 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:19.765044 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-1892c4bc-c6e2-4ef7-8fde-85d3cf6c3b29 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1756 microversion: 2.1 time: 0.168851 Aug 27 01:37:19.765641 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 525/1110] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:19 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:37:19.856508 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-76d1661a-a9cb-4a46-9815-9bd33fcb687c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:19.857142 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-76d1661a-a9cb-4a46-9815-9bd33fcb687c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:19.863097 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-76d1661a-a9cb-4a46-9815-9bd33fcb687c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:19.863543 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-76d1661a-a9cb-4a46-9815-9bd33fcb687c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:19.864310 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-76d1661a-a9cb-4a46-9815-9bd33fcb687c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:19.864745 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-76d1661a-a9cb-4a46-9815-9bd33fcb687c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:20.016789 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-76d1661a-a9cb-4a46-9815-9bd33fcb687c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:20.025309 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-76d1661a-a9cb-4a46-9815-9bd33fcb687c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:20.027136 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-76d1661a-a9cb-4a46-9815-9bd33fcb687c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:20.028582 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-76d1661a-a9cb-4a46-9815-9bd33fcb687c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1730 microversion: 2.20 time: 0.175790 Aug 27 01:37:20.029168 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 586/1111] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:19 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:37:20.770522 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-257b99cd-e5ff-49b7-b9ce-01d76d9c623f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:20.771245 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-257b99cd-e5ff-49b7-b9ce-01d76d9c623f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:20.778119 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-257b99cd-e5ff-49b7-b9ce-01d76d9c623f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:20.778688 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-257b99cd-e5ff-49b7-b9ce-01d76d9c623f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:20.782456 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-257b99cd-e5ff-49b7-b9ce-01d76d9c623f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:20.782456 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-257b99cd-e5ff-49b7-b9ce-01d76d9c623f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:20.783745 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-6fa023fb-052a-4a34-bdde-7eb6e2665081 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:20.784357 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-6fa023fb-052a-4a34-bdde-7eb6e2665081 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:20.790415 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6fa023fb-052a-4a34-bdde-7eb6e2665081 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:20.791157 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6fa023fb-052a-4a34-bdde-7eb6e2665081 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:20.792145 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6fa023fb-052a-4a34-bdde-7eb6e2665081 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:20.792787 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6fa023fb-052a-4a34-bdde-7eb6e2665081 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:20.821124 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-257b99cd-e5ff-49b7-b9ce-01d76d9c623f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:20.821503 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-257b99cd-e5ff-49b7-b9ce-01d76d9c623f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:20.822023 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.objects.instance [None req-257b99cd-e5ff-49b7-b9ce-01d76d9c623f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lazy-loading 'fault' on Instance uuid e4270f24-9903-4782-8633-a676243368a6 {{(pid=108756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:37:20.863162 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-257b99cd-e5ff-49b7-b9ce-01d76d9c623f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:20.871100 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-257b99cd-e5ff-49b7-b9ce-01d76d9c623f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 200 len: 1328 microversion: 2.1 time: 0.104747 Aug 27 01:37:20.871910 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 526/1112] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:20 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 1328 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:37:20.947527 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-6fa023fb-052a-4a34-bdde-7eb6e2665081 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:20.959215 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-6fa023fb-052a-4a34-bdde-7eb6e2665081 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1756 microversion: 2.1 time: 0.180286 Aug 27 01:37:20.959876 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 587/1113] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:20 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:37:21.046974 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-a3da421a-2596-4511-9fe0-9650215ef1b8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:21.048308 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-a3da421a-2596-4511-9fe0-9650215ef1b8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:21.057772 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a3da421a-2596-4511-9fe0-9650215ef1b8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:21.058227 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a3da421a-2596-4511-9fe0-9650215ef1b8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:21.059001 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a3da421a-2596-4511-9fe0-9650215ef1b8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:21.059431 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a3da421a-2596-4511-9fe0-9650215ef1b8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:21.193248 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-a3da421a-2596-4511-9fe0-9650215ef1b8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:21.200943 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-a3da421a-2596-4511-9fe0-9650215ef1b8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:21.202432 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-a3da421a-2596-4511-9fe0-9650215ef1b8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:21.204052 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-a3da421a-2596-4511-9fe0-9650215ef1b8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1730 microversion: 2.20 time: 0.160306 Aug 27 01:37:21.204743 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 527/1114] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:21 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:37:21.888337 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-f57dbdf1-0719-407a-90ff-50f57b6c6dc1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:21.889532 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-f57dbdf1-0719-407a-90ff-50f57b6c6dc1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:21.898315 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f57dbdf1-0719-407a-90ff-50f57b6c6dc1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:21.899290 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f57dbdf1-0719-407a-90ff-50f57b6c6dc1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:21.900261 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f57dbdf1-0719-407a-90ff-50f57b6c6dc1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:21.900876 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f57dbdf1-0719-407a-90ff-50f57b6c6dc1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:21.936758 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f57dbdf1-0719-407a-90ff-50f57b6c6dc1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:21.937232 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f57dbdf1-0719-407a-90ff-50f57b6c6dc1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:21.937794 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.objects.instance [None req-f57dbdf1-0719-407a-90ff-50f57b6c6dc1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lazy-loading 'fault' on Instance uuid e4270f24-9903-4782-8633-a676243368a6 {{(pid=108755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:37:21.976266 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-1fb48c27-d409-4031-b05e-7a6a90165305 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:21.976926 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-1fb48c27-d409-4031-b05e-7a6a90165305 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:21.982016 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-f57dbdf1-0719-407a-90ff-50f57b6c6dc1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:21.983430 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1fb48c27-d409-4031-b05e-7a6a90165305 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:21.984207 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1fb48c27-d409-4031-b05e-7a6a90165305 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:21.985152 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1fb48c27-d409-4031-b05e-7a6a90165305 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:21.985598 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1fb48c27-d409-4031-b05e-7a6a90165305 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:21.993682 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-f57dbdf1-0719-407a-90ff-50f57b6c6dc1 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 200 len: 1328 microversion: 2.1 time: 0.109216 Aug 27 01:37:21.997705 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 588/1115] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:21 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 1328 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:37:22.116852 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-1fb48c27-d409-4031-b05e-7a6a90165305 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:22.125374 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-1fb48c27-d409-4031-b05e-7a6a90165305 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1756 microversion: 2.1 time: 0.152786 Aug 27 01:37:22.126037 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 528/1116] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:21 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1756 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:37:22.222556 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d1dd6bc1-34b3-4dc2-b455-3dd0d4813805 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:22.223167 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d1dd6bc1-34b3-4dc2-b455-3dd0d4813805 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:22.230334 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d1dd6bc1-34b3-4dc2-b455-3dd0d4813805 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:22.230799 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d1dd6bc1-34b3-4dc2-b455-3dd0d4813805 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:22.231583 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d1dd6bc1-34b3-4dc2-b455-3dd0d4813805 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:22.232015 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d1dd6bc1-34b3-4dc2-b455-3dd0d4813805 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:22.365293 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d1dd6bc1-34b3-4dc2-b455-3dd0d4813805 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:22.378219 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d1dd6bc1-34b3-4dc2-b455-3dd0d4813805 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:22.399366 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d1dd6bc1-34b3-4dc2-b455-3dd0d4813805 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:22.399366 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d1dd6bc1-34b3-4dc2-b455-3dd0d4813805 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1730 microversion: 2.20 time: 0.162645 Aug 27 01:37:22.399366 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 589/1117] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:22 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:37:23.012752 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-6052d690-c156-444f-8c80-d01e8045f6fc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:23.013673 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-6052d690-c156-444f-8c80-d01e8045f6fc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:23.020510 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6052d690-c156-444f-8c80-d01e8045f6fc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:23.021072 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6052d690-c156-444f-8c80-d01e8045f6fc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:23.021864 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6052d690-c156-444f-8c80-d01e8045f6fc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:23.022275 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6052d690-c156-444f-8c80-d01e8045f6fc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:23.057692 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6052d690-c156-444f-8c80-d01e8045f6fc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:23.058551 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6052d690-c156-444f-8c80-d01e8045f6fc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:23.059428 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.objects.instance [None req-6052d690-c156-444f-8c80-d01e8045f6fc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lazy-loading 'fault' on Instance uuid e4270f24-9903-4782-8633-a676243368a6 {{(pid=108756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:37:23.101295 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-6052d690-c156-444f-8c80-d01e8045f6fc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:23.111982 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-6052d690-c156-444f-8c80-d01e8045f6fc tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 200 len: 1328 microversion: 2.1 time: 0.103025 Aug 27 01:37:23.113690 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 529/1118] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:23 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 1328 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:37:23.142735 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-fc805643-551f-4b12-bb19-1ffdc050e6b1 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:23.143375 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-fc805643-551f-4b12-bb19-1ffdc050e6b1 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:23.150583 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fc805643-551f-4b12-bb19-1ffdc050e6b1 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:23.151037 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fc805643-551f-4b12-bb19-1ffdc050e6b1 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:23.151818 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fc805643-551f-4b12-bb19-1ffdc050e6b1 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:23.152262 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fc805643-551f-4b12-bb19-1ffdc050e6b1 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:23.285386 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-fc805643-551f-4b12-bb19-1ffdc050e6b1 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:23.293787 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-fc805643-551f-4b12-bb19-1ffdc050e6b1 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1756 microversion: 2.1 time: 0.155239 Aug 27 01:37:23.294359 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 590/1119] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:23 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1756 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:37:23.419857 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-f02dd7d6-0c36-4480-b00b-69b647f34a2e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:23.420096 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-f02dd7d6-0c36-4480-b00b-69b647f34a2e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:23.427212 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f02dd7d6-0c36-4480-b00b-69b647f34a2e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:23.427699 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f02dd7d6-0c36-4480-b00b-69b647f34a2e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:23.428529 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f02dd7d6-0c36-4480-b00b-69b647f34a2e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:23.429004 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f02dd7d6-0c36-4480-b00b-69b647f34a2e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:23.566551 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-f02dd7d6-0c36-4480-b00b-69b647f34a2e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:23.574954 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-f02dd7d6-0c36-4480-b00b-69b647f34a2e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:23.576498 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-f02dd7d6-0c36-4480-b00b-69b647f34a2e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:23.577710 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-f02dd7d6-0c36-4480-b00b-69b647f34a2e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1730 microversion: 2.20 time: 0.164304 Aug 27 01:37:23.578473 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 530/1120] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:23 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:37:24.129711 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-30c19bba-6bd2-48db-a348-6d9577036db9 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:24.130317 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-30c19bba-6bd2-48db-a348-6d9577036db9 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:24.136644 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-30c19bba-6bd2-48db-a348-6d9577036db9 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:24.140494 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-30c19bba-6bd2-48db-a348-6d9577036db9 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:24.140494 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-30c19bba-6bd2-48db-a348-6d9577036db9 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:24.140494 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-30c19bba-6bd2-48db-a348-6d9577036db9 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:24.169430 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-30c19bba-6bd2-48db-a348-6d9577036db9 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:24.170122 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-30c19bba-6bd2-48db-a348-6d9577036db9 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:24.170361 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.objects.instance [None req-30c19bba-6bd2-48db-a348-6d9577036db9 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lazy-loading 'fault' on Instance uuid e4270f24-9903-4782-8633-a676243368a6 {{(pid=108755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:37:24.213722 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-30c19bba-6bd2-48db-a348-6d9577036db9 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:24.225076 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-30c19bba-6bd2-48db-a348-6d9577036db9 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 200 len: 1328 microversion: 2.1 time: 0.099110 Aug 27 01:37:24.229882 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 591/1121] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:24 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 1328 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:37:24.315899 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ff3bf4b0-c6a7-444f-868c-9f21729693a1 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:24.316654 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-ff3bf4b0-c6a7-444f-868c-9f21729693a1 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:24.323529 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ff3bf4b0-c6a7-444f-868c-9f21729693a1 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:24.324164 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ff3bf4b0-c6a7-444f-868c-9f21729693a1 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:24.325209 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ff3bf4b0-c6a7-444f-868c-9f21729693a1 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:24.327201 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ff3bf4b0-c6a7-444f-868c-9f21729693a1 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:24.512210 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ff3bf4b0-c6a7-444f-868c-9f21729693a1 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:24.523291 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-ff3bf4b0-c6a7-444f-868c-9f21729693a1 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1756 microversion: 2.1 time: 0.211122 Aug 27 01:37:24.524168 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 531/1122] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:24 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1756 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:37:24.596346 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-e8c5f743-672e-4089-9667-491aa18cd597 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:24.596993 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-e8c5f743-672e-4089-9667-491aa18cd597 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:24.602888 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e8c5f743-672e-4089-9667-491aa18cd597 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:24.603327 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e8c5f743-672e-4089-9667-491aa18cd597 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:24.604124 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e8c5f743-672e-4089-9667-491aa18cd597 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:24.604661 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e8c5f743-672e-4089-9667-491aa18cd597 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:24.733253 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-e8c5f743-672e-4089-9667-491aa18cd597 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:24.744898 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-e8c5f743-672e-4089-9667-491aa18cd597 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:24.746400 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-e8c5f743-672e-4089-9667-491aa18cd597 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:24.747711 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-e8c5f743-672e-4089-9667-491aa18cd597 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1730 microversion: 2.20 time: 0.155596 Aug 27 01:37:24.748268 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 592/1123] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:24 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:37:25.248953 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-fc273a42-6c8b-4081-8308-8250ce0e3a07 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:25.249765 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-fc273a42-6c8b-4081-8308-8250ce0e3a07 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:25.257744 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fc273a42-6c8b-4081-8308-8250ce0e3a07 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:25.258299 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fc273a42-6c8b-4081-8308-8250ce0e3a07 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:25.259090 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fc273a42-6c8b-4081-8308-8250ce0e3a07 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:25.259615 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fc273a42-6c8b-4081-8308-8250ce0e3a07 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:25.294046 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fc273a42-6c8b-4081-8308-8250ce0e3a07 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:25.294526 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fc273a42-6c8b-4081-8308-8250ce0e3a07 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:25.294949 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.objects.instance [None req-fc273a42-6c8b-4081-8308-8250ce0e3a07 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lazy-loading 'fault' on Instance uuid e4270f24-9903-4782-8633-a676243368a6 {{(pid=108756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:37:25.338543 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-fc273a42-6c8b-4081-8308-8250ce0e3a07 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:25.347027 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-fc273a42-6c8b-4081-8308-8250ce0e3a07 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 200 len: 1328 microversion: 2.1 time: 0.102212 Aug 27 01:37:25.347867 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 532/1124] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:25 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 1328 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:37:25.551464 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-10b70b17-7751-4cd0-b1ef-3ab14b512bac tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:25.553198 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-10b70b17-7751-4cd0-b1ef-3ab14b512bac tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:25.561287 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-10b70b17-7751-4cd0-b1ef-3ab14b512bac tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:25.562093 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-10b70b17-7751-4cd0-b1ef-3ab14b512bac tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:25.563086 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-10b70b17-7751-4cd0-b1ef-3ab14b512bac tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:25.564370 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-10b70b17-7751-4cd0-b1ef-3ab14b512bac tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:25.710991 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-10b70b17-7751-4cd0-b1ef-3ab14b512bac tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:25.720193 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-10b70b17-7751-4cd0-b1ef-3ab14b512bac tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1756 microversion: 2.1 time: 0.175051 Aug 27 01:37:25.721620 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 593/1125] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:25 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:37:25.767153 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c22e6d23-7971-4aac-ab12-a58dca2118ac tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:25.768028 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c22e6d23-7971-4aac-ab12-a58dca2118ac tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:25.774180 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c22e6d23-7971-4aac-ab12-a58dca2118ac tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:25.774620 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c22e6d23-7971-4aac-ab12-a58dca2118ac tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:25.775475 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c22e6d23-7971-4aac-ab12-a58dca2118ac tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:25.775906 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c22e6d23-7971-4aac-ab12-a58dca2118ac tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:25.917073 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c22e6d23-7971-4aac-ab12-a58dca2118ac tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:25.921727 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c22e6d23-7971-4aac-ab12-a58dca2118ac tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:25.924071 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c22e6d23-7971-4aac-ab12-a58dca2118ac tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:25.925245 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c22e6d23-7971-4aac-ab12-a58dca2118ac tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1730 microversion: 2.20 time: 0.161980 Aug 27 01:37:25.925807 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 533/1126] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:25 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:37:26.365087 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-fab096ed-5f68-44ee-a2a8-598d60042816 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:26.366956 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-fab096ed-5f68-44ee-a2a8-598d60042816 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:26.377305 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fab096ed-5f68-44ee-a2a8-598d60042816 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:26.377829 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fab096ed-5f68-44ee-a2a8-598d60042816 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:26.378815 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fab096ed-5f68-44ee-a2a8-598d60042816 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:26.379255 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fab096ed-5f68-44ee-a2a8-598d60042816 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:26.426052 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fab096ed-5f68-44ee-a2a8-598d60042816 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:26.426496 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fab096ed-5f68-44ee-a2a8-598d60042816 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:26.426951 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.objects.instance [None req-fab096ed-5f68-44ee-a2a8-598d60042816 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lazy-loading 'fault' on Instance uuid e4270f24-9903-4782-8633-a676243368a6 {{(pid=108755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:37:26.468409 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-fab096ed-5f68-44ee-a2a8-598d60042816 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:26.476528 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-fab096ed-5f68-44ee-a2a8-598d60042816 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 200 len: 1328 microversion: 2.1 time: 0.115855 Aug 27 01:37:26.478870 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 594/1127] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:26 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 1328 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:37:26.738194 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-7a67217d-92bd-4668-ad4c-002d25320c7e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:26.740001 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-7a67217d-92bd-4668-ad4c-002d25320c7e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:26.747760 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7a67217d-92bd-4668-ad4c-002d25320c7e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:26.748210 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7a67217d-92bd-4668-ad4c-002d25320c7e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:26.749056 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7a67217d-92bd-4668-ad4c-002d25320c7e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:26.749515 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7a67217d-92bd-4668-ad4c-002d25320c7e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:26.900921 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-7a67217d-92bd-4668-ad4c-002d25320c7e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:26.912782 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-7a67217d-92bd-4668-ad4c-002d25320c7e tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1756 microversion: 2.1 time: 0.178927 Aug 27 01:37:26.913619 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 534/1128] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:26 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:37:26.944150 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-3ec95b7c-e496-434c-8697-52877cf85187 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:26.944927 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-3ec95b7c-e496-434c-8697-52877cf85187 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:26.956022 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3ec95b7c-e496-434c-8697-52877cf85187 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:26.956477 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3ec95b7c-e496-434c-8697-52877cf85187 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:26.957289 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3ec95b7c-e496-434c-8697-52877cf85187 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:26.957752 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3ec95b7c-e496-434c-8697-52877cf85187 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:27.092733 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-3ec95b7c-e496-434c-8697-52877cf85187 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:27.101079 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-3ec95b7c-e496-434c-8697-52877cf85187 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:27.102588 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-3ec95b7c-e496-434c-8697-52877cf85187 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:27.103759 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-3ec95b7c-e496-434c-8697-52877cf85187 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1730 microversion: 2.20 time: 0.163455 Aug 27 01:37:27.104626 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 595/1129] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:26 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:37:27.496168 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-19bc1baa-7d43-4c14-b119-67068baa1a3f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:27.496790 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-19bc1baa-7d43-4c14-b119-67068baa1a3f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:27.508528 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-19bc1baa-7d43-4c14-b119-67068baa1a3f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:27.509375 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-19bc1baa-7d43-4c14-b119-67068baa1a3f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:27.510442 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-19bc1baa-7d43-4c14-b119-67068baa1a3f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:27.510880 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-19bc1baa-7d43-4c14-b119-67068baa1a3f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:27.545974 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-19bc1baa-7d43-4c14-b119-67068baa1a3f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:27.546578 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-19bc1baa-7d43-4c14-b119-67068baa1a3f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:27.547036 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.objects.instance [None req-19bc1baa-7d43-4c14-b119-67068baa1a3f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lazy-loading 'fault' on Instance uuid e4270f24-9903-4782-8633-a676243368a6 {{(pid=108756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:37:27.589565 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-19bc1baa-7d43-4c14-b119-67068baa1a3f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:27.599074 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-19bc1baa-7d43-4c14-b119-67068baa1a3f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 200 len: 1328 microversion: 2.1 time: 0.110149 Aug 27 01:37:27.599657 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 535/1130] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:27 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 1328 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:37:28.033568 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-02910013-f040-4787-8797-f99c2f0f0013 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:28.033568 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-02910013-f040-4787-8797-f99c2f0f0013 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:28.033568 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-02910013-f040-4787-8797-f99c2f0f0013 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:28.033568 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-02910013-f040-4787-8797-f99c2f0f0013 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:28.034776 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-02910013-f040-4787-8797-f99c2f0f0013 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:28.034776 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-02910013-f040-4787-8797-f99c2f0f0013 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:28.081352 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-02910013-f040-4787-8797-f99c2f0f0013 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:28.097702 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-02910013-f040-4787-8797-f99c2f0f0013 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1756 microversion: 2.1 time: 0.170268 Aug 27 01:37:28.098940 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 596/1131] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:27 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:37:28.123218 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-4ce13ab5-1216-4cc7-ae26-f523a01a750e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:28.123846 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-4ce13ab5-1216-4cc7-ae26-f523a01a750e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:28.131049 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4ce13ab5-1216-4cc7-ae26-f523a01a750e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:28.131948 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4ce13ab5-1216-4cc7-ae26-f523a01a750e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:28.132751 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4ce13ab5-1216-4cc7-ae26-f523a01a750e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:28.133342 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-4ce13ab5-1216-4cc7-ae26-f523a01a750e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:28.259261 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-4ce13ab5-1216-4cc7-ae26-f523a01a750e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:28.269348 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-4ce13ab5-1216-4cc7-ae26-f523a01a750e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:28.272189 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-4ce13ab5-1216-4cc7-ae26-f523a01a750e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:28.274034 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-4ce13ab5-1216-4cc7-ae26-f523a01a750e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1730 microversion: 2.20 time: 0.154642 Aug 27 01:37:28.274781 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 536/1132] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:28 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:37:28.616879 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-27e0924f-3ec4-4c65-bcbf-751c651dfb22 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:28.617674 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-27e0924f-3ec4-4c65-bcbf-751c651dfb22 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:28.623903 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-27e0924f-3ec4-4c65-bcbf-751c651dfb22 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:28.624343 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-27e0924f-3ec4-4c65-bcbf-751c651dfb22 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:28.626027 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-27e0924f-3ec4-4c65-bcbf-751c651dfb22 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:28.626491 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-27e0924f-3ec4-4c65-bcbf-751c651dfb22 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:28.658637 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-27e0924f-3ec4-4c65-bcbf-751c651dfb22 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:28.659081 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-27e0924f-3ec4-4c65-bcbf-751c651dfb22 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:28.659521 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.objects.instance [None req-27e0924f-3ec4-4c65-bcbf-751c651dfb22 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lazy-loading 'fault' on Instance uuid e4270f24-9903-4782-8633-a676243368a6 {{(pid=108755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:37:28.698771 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-27e0924f-3ec4-4c65-bcbf-751c651dfb22 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa605019ca5c40d897cb30c990710ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d392d1b39ee49d1b87211d5c447f9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:28.706066 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-27e0924f-3ec4-4c65-bcbf-751c651dfb22 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 200 len: 1328 microversion: 2.1 time: 0.093120 Aug 27 01:37:28.706609 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 597/1133] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:28 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 1328 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:37:29.115470 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-0bf5e8ae-0f11-4cb8-a908-b8801f528e68 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:29.116252 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-0bf5e8ae-0f11-4cb8-a908-b8801f528e68 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:29.122904 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0bf5e8ae-0f11-4cb8-a908-b8801f528e68 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:29.123348 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0bf5e8ae-0f11-4cb8-a908-b8801f528e68 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:29.124114 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0bf5e8ae-0f11-4cb8-a908-b8801f528e68 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:29.124540 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0bf5e8ae-0f11-4cb8-a908-b8801f528e68 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:29.263735 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0bf5e8ae-0f11-4cb8-a908-b8801f528e68 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:29.272911 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-0bf5e8ae-0f11-4cb8-a908-b8801f528e68 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1756 microversion: 2.1 time: 0.161050 Aug 27 01:37:29.273475 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 537/1134] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:29 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:37:29.292611 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d50b54d8-fd33-4b88-b3ad-c6606e656aaa tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:29.293256 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d50b54d8-fd33-4b88-b3ad-c6606e656aaa tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:29.299446 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d50b54d8-fd33-4b88-b3ad-c6606e656aaa tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:29.299890 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d50b54d8-fd33-4b88-b3ad-c6606e656aaa tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:29.300663 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d50b54d8-fd33-4b88-b3ad-c6606e656aaa tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:29.301122 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d50b54d8-fd33-4b88-b3ad-c6606e656aaa tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:29.430735 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d50b54d8-fd33-4b88-b3ad-c6606e656aaa tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:29.438658 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d50b54d8-fd33-4b88-b3ad-c6606e656aaa tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:29.440148 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d50b54d8-fd33-4b88-b3ad-c6606e656aaa tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:29.441305 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d50b54d8-fd33-4b88-b3ad-c6606e656aaa tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1730 microversion: 2.20 time: 0.152575 Aug 27 01:37:29.456425 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 598/1135] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:29 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:37:29.722932 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-2a77a6d6-7abd-4ce7-9ef2-5e06666da062 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:29.723537 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-2a77a6d6-7abd-4ce7-9ef2-5e06666da062 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:29.729359 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2a77a6d6-7abd-4ce7-9ef2-5e06666da062 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:29.729804 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2a77a6d6-7abd-4ce7-9ef2-5e06666da062 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:29.730564 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2a77a6d6-7abd-4ce7-9ef2-5e06666da062 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:29.730994 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2a77a6d6-7abd-4ce7-9ef2-5e06666da062 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:29.743748 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.wsgi [None req-2a77a6d6-7abd-4ce7-9ef2-5e06666da062 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] HTTP exception thrown: Instance e4270f24-9903-4782-8633-a676243368a6 could not be found. Aug 27 01:37:29.744327 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-2a77a6d6-7abd-4ce7-9ef2-5e06666da062 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Returning 404 to user: Instance e4270f24-9903-4782-8633-a676243368a6 could not be found. {{(pid=108756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:37:29.745148 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-2a77a6d6-7abd-4ce7-9ef2-5e06666da062 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 404 len: 111 microversion: 2.1 time: 0.026492 Aug 27 01:37:29.745652 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 538/1136] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:29 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:37:29.754108 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-c4e9d3d6-ac60-4cae-8dd2-0ce9cfa7896f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '.version_select at 0x7ff21412a1f0>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:29.838205 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-c4e9d3d6-ac60-4cae-8dd2-0ce9cfa7896f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2109729856" status: 202 len: 0 microversion: 2.1 time: 0.088138 Aug 27 01:37:29.838976 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 599/1137] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Aug 27 01:37:29 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2109729856 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:37:30.289779 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-e0ba5051-b1e0-4364-b611-7625eccf0ccb tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:30.290415 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-e0ba5051-b1e0-4364-b611-7625eccf0ccb tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:30.296430 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e0ba5051-b1e0-4364-b611-7625eccf0ccb tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:30.296903 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e0ba5051-b1e0-4364-b611-7625eccf0ccb tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:30.301703 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e0ba5051-b1e0-4364-b611-7625eccf0ccb tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:30.301703 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e0ba5051-b1e0-4364-b611-7625eccf0ccb tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:30.460007 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-3aa02d2b-5920-438a-b56d-e01f2fe97624 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:30.460845 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-3aa02d2b-5920-438a-b56d-e01f2fe97624 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:30.466781 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3aa02d2b-5920-438a-b56d-e01f2fe97624 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:30.470509 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3aa02d2b-5920-438a-b56d-e01f2fe97624 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:30.470509 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3aa02d2b-5920-438a-b56d-e01f2fe97624 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:30.470509 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-3aa02d2b-5920-438a-b56d-e01f2fe97624 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:30.472225 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-e0ba5051-b1e0-4364-b611-7625eccf0ccb tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:30.480535 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-e0ba5051-b1e0-4364-b611-7625eccf0ccb tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1759 microversion: 2.1 time: 0.194308 Aug 27 01:37:30.481162 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 539/1138] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:30 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1759 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:37:30.605863 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-3aa02d2b-5920-438a-b56d-e01f2fe97624 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:30.614295 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-3aa02d2b-5920-438a-b56d-e01f2fe97624 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:30.615797 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-3aa02d2b-5920-438a-b56d-e01f2fe97624 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:30.616975 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-3aa02d2b-5920-438a-b56d-e01f2fe97624 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1730 microversion: 2.20 time: 0.160847 Aug 27 01:37:30.617546 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 600/1139] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:30 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:37:31.637796 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ac859813-629c-47da-abbd-c78ae9bddeec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:31.638401 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-ac859813-629c-47da-abbd-c78ae9bddeec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:31.645476 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ac859813-629c-47da-abbd-c78ae9bddeec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:31.645924 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ac859813-629c-47da-abbd-c78ae9bddeec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:31.646692 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ac859813-629c-47da-abbd-c78ae9bddeec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:31.647130 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ac859813-629c-47da-abbd-c78ae9bddeec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:31.783251 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ac859813-629c-47da-abbd-c78ae9bddeec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:31.791025 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ac859813-629c-47da-abbd-c78ae9bddeec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:31.792539 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ac859813-629c-47da-abbd-c78ae9bddeec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:31.793702 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-ac859813-629c-47da-abbd-c78ae9bddeec tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1730 microversion: 2.20 time: 0.159715 Aug 27 01:37:31.794259 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 540/1140] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:31 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:37:32.813675 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-f77d9eff-2e4e-4c68-a47d-89d3cba538ef tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:32.816330 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-f77d9eff-2e4e-4c68-a47d-89d3cba538ef tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:32.820445 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f77d9eff-2e4e-4c68-a47d-89d3cba538ef tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:32.821030 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f77d9eff-2e4e-4c68-a47d-89d3cba538ef tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:32.821817 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f77d9eff-2e4e-4c68-a47d-89d3cba538ef tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:32.822262 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f77d9eff-2e4e-4c68-a47d-89d3cba538ef tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:32.950295 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-f77d9eff-2e4e-4c68-a47d-89d3cba538ef tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:32.957676 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-f77d9eff-2e4e-4c68-a47d-89d3cba538ef tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:32.959182 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-f77d9eff-2e4e-4c68-a47d-89d3cba538ef tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:32.960311 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-f77d9eff-2e4e-4c68-a47d-89d3cba538ef tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1730 microversion: 2.20 time: 0.150922 Aug 27 01:37:32.960861 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 601/1141] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:32 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:37:33.245034 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-72cefa8f-0f57-4e8c-afc6-0cae48424b3f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:33.245555 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-72cefa8f-0f57-4e8c-afc6-0cae48424b3f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:33.252470 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-72cefa8f-0f57-4e8c-afc6-0cae48424b3f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:33.252959 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-72cefa8f-0f57-4e8c-afc6-0cae48424b3f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:33.253735 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-72cefa8f-0f57-4e8c-afc6-0cae48424b3f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:33.254172 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-72cefa8f-0f57-4e8c-afc6-0cae48424b3f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:33.267692 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.wsgi [None req-72cefa8f-0f57-4e8c-afc6-0cae48424b3f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] HTTP exception thrown: Instance e4270f24-9903-4782-8633-a676243368a6 could not be found. Aug 27 01:37:33.268287 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-72cefa8f-0f57-4e8c-afc6-0cae48424b3f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Returning 404 to user: Instance e4270f24-9903-4782-8633-a676243368a6 could not be found. {{(pid=108756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:37:33.269137 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-72cefa8f-0f57-4e8c-afc6-0cae48424b3f tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 404 len: 111 microversion: 2.1 time: 0.027750 Aug 27 01:37:33.269673 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 541/1142] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Aug 27 01:37:33 2021] DELETE /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:37:33.277190 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-0ac57771-7996-404c-8fce-882bbb7d14fb tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:33.277884 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-0ac57771-7996-404c-8fce-882bbb7d14fb tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: e4270f24-9903-4782-8633-a676243368a6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:33.284280 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0ac57771-7996-404c-8fce-882bbb7d14fb tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:33.284732 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0ac57771-7996-404c-8fce-882bbb7d14fb tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:33.285533 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0ac57771-7996-404c-8fce-882bbb7d14fb tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:33.285965 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0ac57771-7996-404c-8fce-882bbb7d14fb tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:33.300447 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.wsgi [None req-0ac57771-7996-404c-8fce-882bbb7d14fb tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] HTTP exception thrown: Instance e4270f24-9903-4782-8633-a676243368a6 could not be found. Aug 27 01:37:33.304741 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-0ac57771-7996-404c-8fce-882bbb7d14fb tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Returning 404 to user: Instance e4270f24-9903-4782-8633-a676243368a6 could not be found. {{(pid=108755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:37:33.304741 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-0ac57771-7996-404c-8fce-882bbb7d14fb tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6" status: 404 len: 111 microversion: 2.1 time: 0.028301 Aug 27 01:37:33.304741 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 602/1143] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:33 2021] GET /compute/v2.1/servers/e4270f24-9903-4782-8633-a676243368a6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:37:33.978355 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-f5be8d8e-c957-411c-aba8-8cca01a44d0c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:33.979254 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-f5be8d8e-c957-411c-aba8-8cca01a44d0c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:33.985954 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f5be8d8e-c957-411c-aba8-8cca01a44d0c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:33.990604 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f5be8d8e-c957-411c-aba8-8cca01a44d0c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:33.990604 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f5be8d8e-c957-411c-aba8-8cca01a44d0c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:33.990604 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f5be8d8e-c957-411c-aba8-8cca01a44d0c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:34.118703 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-f5be8d8e-c957-411c-aba8-8cca01a44d0c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:34.127267 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-f5be8d8e-c957-411c-aba8-8cca01a44d0c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:34.129040 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-f5be8d8e-c957-411c-aba8-8cca01a44d0c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:34.141442 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-f5be8d8e-c957-411c-aba8-8cca01a44d0c tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1730 microversion: 2.20 time: 0.155834 Aug 27 01:37:34.141442 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 542/1144] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:33 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:37:34.634402 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b78fb511-52a8-4bdb-a5d7-cd8c26d397e5 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:34.634911 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b78fb511-52a8-4bdb-a5d7-cd8c26d397e5 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:34.640560 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b78fb511-52a8-4bdb-a5d7-cd8c26d397e5 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:34.641761 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b78fb511-52a8-4bdb-a5d7-cd8c26d397e5 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:34.642647 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b78fb511-52a8-4bdb-a5d7-cd8c26d397e5 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:34.643266 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b78fb511-52a8-4bdb-a5d7-cd8c26d397e5 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:34.659070 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.wsgi [None req-b78fb511-52a8-4bdb-a5d7-cd8c26d397e5 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] HTTP exception thrown: Instance be807b17-abdc-4d79-b58d-b42998cdb479 could not be found. Aug 27 01:37:34.659670 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b78fb511-52a8-4bdb-a5d7-cd8c26d397e5 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Returning 404 to user: Instance be807b17-abdc-4d79-b58d-b42998cdb479 could not be found. {{(pid=108755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:37:34.660501 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b78fb511-52a8-4bdb-a5d7-cd8c26d397e5 tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "DELETE /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 404 len: 111 microversion: 2.1 time: 0.029818 Aug 27 01:37:34.661080 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 603/1145] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Aug 27 01:37:34 2021] DELETE /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:37:34.669986 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-264ef220-500e-457c-ab52-989b73b95bcd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:34.670805 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-264ef220-500e-457c-ab52-989b73b95bcd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] [instance: be807b17-abdc-4d79-b58d-b42998cdb479] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:34.678953 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-264ef220-500e-457c-ab52-989b73b95bcd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:34.679550 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-264ef220-500e-457c-ab52-989b73b95bcd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:34.680608 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-264ef220-500e-457c-ab52-989b73b95bcd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:34.681075 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-264ef220-500e-457c-ab52-989b73b95bcd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:34.698181 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.wsgi [None req-264ef220-500e-457c-ab52-989b73b95bcd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] HTTP exception thrown: Instance be807b17-abdc-4d79-b58d-b42998cdb479 could not be found. Aug 27 01:37:34.698785 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-264ef220-500e-457c-ab52-989b73b95bcd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] Returning 404 to user: Instance be807b17-abdc-4d79-b58d-b42998cdb479 could not be found. {{(pid=108756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:37:34.699688 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-264ef220-500e-457c-ab52-989b73b95bcd tempest-AttachVolumeTestJSON-2090519803 tempest-AttachVolumeTestJSON-2090519803-project] 10.222.0.25 "GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479" status: 404 len: 111 microversion: 2.1 time: 0.034317 Aug 27 01:37:34.700236 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 543/1146] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:37:34 2021] GET /compute/v2.1/servers/be807b17-abdc-4d79-b58d-b42998cdb479 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:37:35.147935 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-fe7415a6-2639-4d0e-8249-e10f20fea071 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:35.148534 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-fe7415a6-2639-4d0e-8249-e10f20fea071 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:35.154198 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fe7415a6-2639-4d0e-8249-e10f20fea071 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:35.154640 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fe7415a6-2639-4d0e-8249-e10f20fea071 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:35.155455 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fe7415a6-2639-4d0e-8249-e10f20fea071 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:35.155854 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fe7415a6-2639-4d0e-8249-e10f20fea071 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:35.277315 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-fe7415a6-2639-4d0e-8249-e10f20fea071 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:35.288105 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-fe7415a6-2639-4d0e-8249-e10f20fea071 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:35.289018 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-fe7415a6-2639-4d0e-8249-e10f20fea071 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:35.290402 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-fe7415a6-2639-4d0e-8249-e10f20fea071 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1730 microversion: 2.20 time: 0.145564 Aug 27 01:37:35.290402 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 604/1147] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:35 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:37:35.454022 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-88104b76-0f65-49b6-a2b3-c7f6f8a9f987 req-4b7cd1ae-8542-4042-b96e-78b6513e7ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b8f116a-f7c5-4c53-83b6-22034d528599", "name": "network-vif-plugged", "status": "completed", "tag": "39c29f7a-a8f4-47b8-b7f9-8153941ce167"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:37:35.455764 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:37:35.455764 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:37:35.462777 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-88104b76-0f65-49b6-a2b3-c7f6f8a9f987 req-4b7cd1ae-8542-4042-b96e-78b6513e7ec6 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:35.463220 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-88104b76-0f65-49b6-a2b3-c7f6f8a9f987 req-4b7cd1ae-8542-4042-b96e-78b6513e7ec6 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:35.475169 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-88104b76-0f65-49b6-a2b3-c7f6f8a9f987 req-4b7cd1ae-8542-4042-b96e-78b6513e7ec6 service nova] Creating event network-vif-plugged:39c29f7a-a8f4-47b8-b7f9-8153941ce167 for instance 3b8f116a-f7c5-4c53-83b6-22034d528599 on hv-cinder-75916 Aug 27 01:37:35.480136 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-88104b76-0f65-49b6-a2b3-c7f6f8a9f987 req-4b7cd1ae-8542-4042-b96e-78b6513e7ec6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030448 Aug 27 01:37:35.480713 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 544/1148] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:37:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:37:36.316718 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-a9a8385f-7a72-4874-9259-c1ae10fbcf27 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:36.317532 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-a9a8385f-7a72-4874-9259-c1ae10fbcf27 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:36.324485 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a9a8385f-7a72-4874-9259-c1ae10fbcf27 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:36.325103 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a9a8385f-7a72-4874-9259-c1ae10fbcf27 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:36.326118 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a9a8385f-7a72-4874-9259-c1ae10fbcf27 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:36.327305 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a9a8385f-7a72-4874-9259-c1ae10fbcf27 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:36.482092 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-a9a8385f-7a72-4874-9259-c1ae10fbcf27 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:36.491361 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-a9a8385f-7a72-4874-9259-c1ae10fbcf27 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:36.492983 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-a9a8385f-7a72-4874-9259-c1ae10fbcf27 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:36.494249 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-a9a8385f-7a72-4874-9259-c1ae10fbcf27 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1730 microversion: 2.20 time: 0.182497 Aug 27 01:37:36.494885 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 605/1149] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:36 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:37:37.511878 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ab7952ec-78d1-4e4e-844b-96826d2539b9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:37.512561 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-ab7952ec-78d1-4e4e-844b-96826d2539b9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:37.519261 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ab7952ec-78d1-4e4e-844b-96826d2539b9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:37.519696 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ab7952ec-78d1-4e4e-844b-96826d2539b9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:37.520475 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ab7952ec-78d1-4e4e-844b-96826d2539b9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:37.520961 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ab7952ec-78d1-4e4e-844b-96826d2539b9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:37.724238 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ab7952ec-78d1-4e4e-844b-96826d2539b9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:37.734940 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ab7952ec-78d1-4e4e-844b-96826d2539b9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:37.738672 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ab7952ec-78d1-4e4e-844b-96826d2539b9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:37.738672 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-ab7952ec-78d1-4e4e-844b-96826d2539b9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1730 microversion: 2.20 time: 0.230199 Aug 27 01:37:37.739552 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 545/1150] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:37 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1730 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:37:38.756432 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-0768b25e-8727-41d9-9a8e-618730fac414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:38.757011 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-0768b25e-8727-41d9-9a8e-618730fac414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:37:38.762875 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0768b25e-8727-41d9-9a8e-618730fac414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:38.763318 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0768b25e-8727-41d9-9a8e-618730fac414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:38.764072 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0768b25e-8727-41d9-9a8e-618730fac414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:37:38.764504 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0768b25e-8727-41d9-9a8e-618730fac414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:37:38.895176 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-0768b25e-8727-41d9-9a8e-618730fac414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:38.902824 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-0768b25e-8727-41d9-9a8e-618730fac414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:38.904378 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-0768b25e-8727-41d9-9a8e-618730fac414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:37:38.905525 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-0768b25e-8727-41d9-9a8e-618730fac414 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1717 microversion: 2.20 time: 0.152870 Aug 27 01:37:38.906074 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 606/1151] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:37:38 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1717 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:37:42.263975 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-5c76a80e-b165-455f-a343-389b8a6ab410 tempest-VolumesTestJSON-1964666798 tempest-VolumesTestJSON-1964666798-project] Calling method '.version_select at 0x7ff217eacee0>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:42.314477 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-5c76a80e-b165-455f-a343-389b8a6ab410 tempest-VolumesTestJSON-1964666798 tempest-VolumesTestJSON-1964666798-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/fda8eb38-ef41-4072-8443-ce9352df5733" status: 200 len: 351 microversion: 2.1 time: 0.053959 Aug 27 01:37:42.315026 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 546/1152] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Aug 27 01:37:42 2021] GET /compute/v2.1/os-volumes/fda8eb38-ef41-4072-8443-ce9352df5733 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:37:43.943964 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-a1891592-4164-46b1-8dd6-70ce986a747f tempest-VolumesTestJSON-1964666798 tempest-VolumesTestJSON-1964666798-project] Calling method '.version_select at 0x7ff2140e4160>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:43.993203 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-a1891592-4164-46b1-8dd6-70ce986a747f tempest-VolumesTestJSON-1964666798 tempest-VolumesTestJSON-1964666798-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/43f3e5b3-1758-4a7a-a5d1-61486c14a56d" status: 200 len: 350 microversion: 2.1 time: 0.052809 Aug 27 01:37:43.993751 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 607/1153] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Aug 27 01:37:43 2021] GET /compute/v2.1/os-volumes/43f3e5b3-1758-4a7a-a5d1-61486c14a56d => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:37:45.820815 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ca208360-72e7-490a-a263-579a774bce5c tempest-VolumesTestJSON-1964666798 tempest-VolumesTestJSON-1964666798-project] Calling method '.version_select at 0x7ff2141199d0>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:45.875207 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-ca208360-72e7-490a-a263-579a774bce5c tempest-VolumesTestJSON-1964666798 tempest-VolumesTestJSON-1964666798-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/73113e50-df83-4d88-b65d-7640a21eb4cb" status: 200 len: 351 microversion: 2.1 time: 0.054799 Aug 27 01:37:45.875207 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 547/1154] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Aug 27 01:37:45 2021] GET /compute/v2.1/os-volumes/73113e50-df83-4d88-b65d-7640a21eb4cb => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:37:45.884898 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-1446cb3c-3810-4f2d-b4ef-9c1da8170fb2 tempest-VolumesTestJSON-1964666798 tempest-VolumesTestJSON-1964666798-project] Calling method '.version_select at 0x7ff2140999d0>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:45.966120 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-1446cb3c-3810-4f2d-b4ef-9c1da8170fb2 tempest-VolumesTestJSON-1964666798 tempest-VolumesTestJSON-1964666798-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084819 Aug 27 01:37:45.966735 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 608/1155] 10.222.0.25 () {58 vars in 1134 bytes} [Fri Aug 27 01:37:45 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:37:45.978933 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ebebb569-6abf-4fcd-a1ea-7ef621053f54 tempest-VolumesTestJSON-1964666798 tempest-VolumesTestJSON-1964666798-project] Calling method '.version_select at 0x7ff217e7c0d0>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:46.056489 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-ebebb569-6abf-4fcd-a1ea-7ef621053f54 tempest-VolumesTestJSON-1964666798 tempest-VolumesTestJSON-1964666798-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.081117 Aug 27 01:37:46.057112 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 548/1156] 10.222.0.25 () {58 vars in 1149 bytes} [Fri Aug 27 01:37:45 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:37:46.069018 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-bd62c15c-57c8-4ae9-93f4-ca80bd4f933e tempest-VolumesTestJSON-1964666798 tempest-VolumesTestJSON-1964666798-project] Calling method '.version_select at 0x7ff214101af0>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:46.149707 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-bd62c15c-57c8-4ae9-93f4-ca80bd4f933e tempest-VolumesTestJSON-1964666798 tempest-VolumesTestJSON-1964666798-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084107 Aug 27 01:37:46.150265 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 609/1157] 10.222.0.25 () {58 vars in 1134 bytes} [Fri Aug 27 01:37:46 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:37:46.162218 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c24fb484-be6f-48ce-bee2-c15735a43022 tempest-VolumesTestJSON-1964666798 tempest-VolumesTestJSON-1964666798-project] Calling method '.version_select at 0x7ff217e7cee0>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:46.240590 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c24fb484-be6f-48ce-bee2-c15735a43022 tempest-VolumesTestJSON-1964666798 tempest-VolumesTestJSON-1964666798-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.081950 Aug 27 01:37:46.241186 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 549/1158] 10.222.0.25 () {58 vars in 1167 bytes} [Fri Aug 27 01:37:46 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:37:46.253013 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-9e2adf2a-0ccf-4e5c-b843-e22cc59b44e6 tempest-VolumesTestJSON-1964666798 tempest-VolumesTestJSON-1964666798-project] Calling method '.version_select at 0x7ff214101940>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:46.332337 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-9e2adf2a-0ccf-4e5c-b843-e22cc59b44e6 tempest-VolumesTestJSON-1964666798 tempest-VolumesTestJSON-1964666798-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.083473 Aug 27 01:37:46.332924 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 610/1159] 10.222.0.25 () {58 vars in 1170 bytes} [Fri Aug 27 01:37:46 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:37:46.345727 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-402c9a16-946b-4aa9-ab18-616df5203f6c tempest-VolumesTestJSON-1964666798 tempest-VolumesTestJSON-1964666798-project] Calling method '.version_select at 0x7ff21418a550>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:46.426866 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-402c9a16-946b-4aa9-ab18-616df5203f6c tempest-VolumesTestJSON-1964666798 tempest-VolumesTestJSON-1964666798-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085843 Aug 27 01:37:46.427427 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 550/1160] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Aug 27 01:37:46 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:37:46.438117 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-00887b6a-dd35-44e9-87d5-fc0b5eda8a02 tempest-VolumesTestJSON-1964666798 tempest-VolumesTestJSON-1964666798-project] Calling method '.version_select at 0x7ff2140e44c0>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:46.519848 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-00887b6a-dd35-44e9-87d5-fc0b5eda8a02 tempest-VolumesTestJSON-1964666798 tempest-VolumesTestJSON-1964666798-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085301 Aug 27 01:37:46.520494 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 611/1161] 10.222.0.25 () {58 vars in 1188 bytes} [Fri Aug 27 01:37:46 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:37:46.533968 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-a7a39ca6-d7d9-4502-ae6b-41d598c8f216 tempest-VolumesTestJSON-1964666798 tempest-VolumesTestJSON-1964666798-project] Calling method '.version_select at 0x7ff217f75a60>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:37:46.617076 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-a7a39ca6-d7d9-4502-ae6b-41d598c8f216 tempest-VolumesTestJSON-1964666798 tempest-VolumesTestJSON-1964666798-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.089096 Aug 27 01:37:46.617645 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 551/1162] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Aug 27 01:37:46 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:38:00.496281 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-fc81b117-12f9-425b-91ed-1dd805ba9e9f tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2105300849"}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:38:00.497095 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-fc81b117-12f9-425b-91ed-1dd805ba9e9f tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:00.503740 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fc81b117-12f9-425b-91ed-1dd805ba9e9f tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:00.504239 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fc81b117-12f9-425b-91ed-1dd805ba9e9f tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:00.505328 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fc81b117-12f9-425b-91ed-1dd805ba9e9f tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:00.505826 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fc81b117-12f9-425b-91ed-1dd805ba9e9f tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:00.630961 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.network.security_group_api [None req-fc81b117-12f9-425b-91ed-1dd805ba9e9f tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Removing security group f7df4755-d6ea-4026-bf63-a75d3e9e9361 from port ecfa3830-4bf2-43df-94c3-c0d06632b36e Aug 27 01:38:01.041575 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-fc81b117-12f9-425b-91ed-1dd805ba9e9f tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "POST /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa/action" status: 202 len: 0 microversion: 2.1 time: 0.548779 Aug 27 01:38:01.042554 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 612/1163] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:38:00 2021] POST /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:38:01.052180 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-60bd73f5-903b-42e4-b548-801e6576a5be req-2c744ab9-c1f9-4d21-93e0-13a1303f25aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05daee4f-8e0c-4b0f-955f-09527893b2fa", "tag": "ecfa3830-4bf2-43df-94c3-c0d06632b36e"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:38:01.053727 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:38:01.053727 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:38:01.066416 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-60bd73f5-903b-42e4-b548-801e6576a5be req-2c744ab9-c1f9-4d21-93e0-13a1303f25aa service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:01.068597 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-60bd73f5-903b-42e4-b548-801e6576a5be req-2c744ab9-c1f9-4d21-93e0-13a1303f25aa service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:01.085999 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-60bd73f5-903b-42e4-b548-801e6576a5be req-2c744ab9-c1f9-4d21-93e0-13a1303f25aa service nova] Creating event network-changed:ecfa3830-4bf2-43df-94c3-c0d06632b36e for instance 05daee4f-8e0c-4b0f-955f-09527893b2fa on hv-cinder-75916 Aug 27 01:38:01.105980 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-60bd73f5-903b-42e4-b548-801e6576a5be req-2c744ab9-c1f9-4d21-93e0-13a1303f25aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056447 Aug 27 01:38:01.106391 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 552/1164] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:38:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:38:02.369729 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-8b11bd44-9253-4336-ae2b-54f1eebd82ea tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:02.369729 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-8b11bd44-9253-4336-ae2b-54f1eebd82ea tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:02.373988 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-eb8dce63-e9b6-460e-8839-659bd1731035 req-5c065802-86dd-4a26-9f1a-cf6f1c4b7703 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05daee4f-8e0c-4b0f-955f-09527893b2fa", "tag": "ecfa3830-4bf2-43df-94c3-c0d06632b36e"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:38:02.375119 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8b11bd44-9253-4336-ae2b-54f1eebd82ea tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:02.375761 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:38:02.375761 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:38:02.376220 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8b11bd44-9253-4336-ae2b-54f1eebd82ea tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:02.377536 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8b11bd44-9253-4336-ae2b-54f1eebd82ea tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:02.378413 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8b11bd44-9253-4336-ae2b-54f1eebd82ea tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:02.387025 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-eb8dce63-e9b6-460e-8839-659bd1731035 req-5c065802-86dd-4a26-9f1a-cf6f1c4b7703 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:02.387466 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-eb8dce63-e9b6-460e-8839-659bd1731035 req-5c065802-86dd-4a26-9f1a-cf6f1c4b7703 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:02.403415 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-eb8dce63-e9b6-460e-8839-659bd1731035 req-5c065802-86dd-4a26-9f1a-cf6f1c4b7703 service nova] Creating event network-changed:ecfa3830-4bf2-43df-94c3-c0d06632b36e for instance 05daee4f-8e0c-4b0f-955f-09527893b2fa on hv-cinder-75916 Aug 27 01:38:02.411822 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-eb8dce63-e9b6-460e-8839-659bd1731035 req-5c065802-86dd-4a26-9f1a-cf6f1c4b7703 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042313 Aug 27 01:38:02.422206 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 553/1165] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:38:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:38:02.521416 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.objects.instance [None req-8b11bd44-9253-4336-ae2b-54f1eebd82ea tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lazy-loading 'services' on Instance uuid 05daee4f-8e0c-4b0f-955f-09527893b2fa {{(pid=108755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:38:02.773318 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-8b11bd44-9253-4336-ae2b-54f1eebd82ea tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "DELETE /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa/os-volume_attachments/dfc1a2be-a267-4367-b267-e95712c5c925" status: 202 len: 0 microversion: 2.1 time: 0.408952 Aug 27 01:38:02.774154 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 613/1166] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Aug 27 01:38:02 2021] DELETE /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa/os-volume_attachments/dfc1a2be-a267-4367-b267-e95712c5c925 => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:38:02.783236 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-6818ce5f-ddfc-4dd5-9350-865946871a91 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:02.784638 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-6818ce5f-ddfc-4dd5-9350-865946871a91 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:02.792429 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6818ce5f-ddfc-4dd5-9350-865946871a91 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:02.793279 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6818ce5f-ddfc-4dd5-9350-865946871a91 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:02.801970 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6818ce5f-ddfc-4dd5-9350-865946871a91 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:02.801970 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6818ce5f-ddfc-4dd5-9350-865946871a91 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:02.831658 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-6818ce5f-ddfc-4dd5-9350-865946871a91 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052526 Aug 27 01:38:02.832156 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 554/1167] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:38:02 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:38:03.843913 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-caae112c-b880-405b-ab7d-74bcbe0b4983 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:03.845554 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-caae112c-b880-405b-ab7d-74bcbe0b4983 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:03.852360 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-caae112c-b880-405b-ab7d-74bcbe0b4983 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:03.854822 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-caae112c-b880-405b-ab7d-74bcbe0b4983 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:03.854822 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-caae112c-b880-405b-ab7d-74bcbe0b4983 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:03.854822 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-caae112c-b880-405b-ab7d-74bcbe0b4983 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:03.882617 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-caae112c-b880-405b-ab7d-74bcbe0b4983 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042726 Aug 27 01:38:03.883663 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 614/1168] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:38:03 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:38:04.893453 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-530eb6a4-df08-4e4c-8e28-e3cdc0b1e2a8 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:04.894351 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-530eb6a4-df08-4e4c-8e28-e3cdc0b1e2a8 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:04.900313 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-530eb6a4-df08-4e4c-8e28-e3cdc0b1e2a8 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:04.900753 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-530eb6a4-df08-4e4c-8e28-e3cdc0b1e2a8 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:04.901550 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-530eb6a4-df08-4e4c-8e28-e3cdc0b1e2a8 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:04.901979 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-530eb6a4-df08-4e4c-8e28-e3cdc0b1e2a8 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:04.932628 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-530eb6a4-df08-4e4c-8e28-e3cdc0b1e2a8 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042856 Aug 27 01:38:04.933213 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 555/1169] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Aug 27 01:38:04 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 01:38:04.946380 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-cb3e3c8e-514a-474b-b76a-b25b520dc179 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:04.946873 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-cb3e3c8e-514a-474b-b76a-b25b520dc179 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:04.952610 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-cb3e3c8e-514a-474b-b76a-b25b520dc179 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:04.953087 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-cb3e3c8e-514a-474b-b76a-b25b520dc179 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:04.953854 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-cb3e3c8e-514a-474b-b76a-b25b520dc179 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:04.954290 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-cb3e3c8e-514a-474b-b76a-b25b520dc179 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:05.030230 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.wsgi [None req-cb3e3c8e-514a-474b-b76a-b25b520dc179 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] HTTP exception thrown: Instance 05daee4f-8e0c-4b0f-955f-09527893b2fa is not attached to volume dfc1a2be-a267-4367-b267-e95712c5c925 Aug 27 01:38:05.030831 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-cb3e3c8e-514a-474b-b76a-b25b520dc179 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Returning 404 to user: Instance 05daee4f-8e0c-4b0f-955f-09527893b2fa is not attached to volume dfc1a2be-a267-4367-b267-e95712c5c925 {{(pid=108755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:38:05.031668 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-cb3e3c8e-514a-474b-b76a-b25b520dc179 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "DELETE /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa/os-volume_attachments/dfc1a2be-a267-4367-b267-e95712c5c925" status: 404 len: 154 microversion: 2.1 time: 0.089166 Aug 27 01:38:05.032205 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 615/1170] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Aug 27 01:38:04 2021] DELETE /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa/os-volume_attachments/dfc1a2be-a267-4367-b267-e95712c5c925 => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:38:06.345618 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-89508811-cdf1-4c05-9ba9-d1b8f7aa3824 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:06.346177 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-89508811-cdf1-4c05-9ba9-d1b8f7aa3824 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:06.354714 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-89508811-cdf1-4c05-9ba9-d1b8f7aa3824 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:06.354714 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-89508811-cdf1-4c05-9ba9-d1b8f7aa3824 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:06.354714 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-89508811-cdf1-4c05-9ba9-d1b8f7aa3824 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:06.354714 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-89508811-cdf1-4c05-9ba9-d1b8f7aa3824 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:06.381468 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-89508811-cdf1-4c05-9ba9-d1b8f7aa3824 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Going to try to terminate instance {{(pid=108756) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 01:38:06.733752 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-89508811-cdf1-4c05-9ba9-d1b8f7aa3824 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "DELETE /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 204 len: 0 microversion: 2.1 time: 0.391719 Aug 27 01:38:06.734379 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 556/1171] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Aug 27 01:38:06 2021] DELETE /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 01:38:06.743929 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-04e393f8-c5a4-4a09-8673-e15d2ac15fa9 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:06.744671 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-04e393f8-c5a4-4a09-8673-e15d2ac15fa9 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:06.750789 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-04e393f8-c5a4-4a09-8673-e15d2ac15fa9 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:06.751283 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-04e393f8-c5a4-4a09-8673-e15d2ac15fa9 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:06.752131 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-04e393f8-c5a4-4a09-8673-e15d2ac15fa9 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:06.752567 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-04e393f8-c5a4-4a09-8673-e15d2ac15fa9 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:06.896947 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-04e393f8-c5a4-4a09-8673-e15d2ac15fa9 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:38:06.904137 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-04e393f8-c5a4-4a09-8673-e15d2ac15fa9 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1554 microversion: 2.1 time: 0.165189 Aug 27 01:38:06.904691 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 616/1172] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:38:06 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:38:07.921377 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-459ee4a8-fbe0-4e13-ad6a-2af179d8c5fd tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:07.922135 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-459ee4a8-fbe0-4e13-ad6a-2af179d8c5fd tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:07.929055 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-459ee4a8-fbe0-4e13-ad6a-2af179d8c5fd tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:07.929499 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-459ee4a8-fbe0-4e13-ad6a-2af179d8c5fd tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:07.930265 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-459ee4a8-fbe0-4e13-ad6a-2af179d8c5fd tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:07.930693 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-459ee4a8-fbe0-4e13-ad6a-2af179d8c5fd tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:08.090359 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-459ee4a8-fbe0-4e13-ad6a-2af179d8c5fd tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:38:08.097857 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-459ee4a8-fbe0-4e13-ad6a-2af179d8c5fd tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1554 microversion: 2.1 time: 0.180446 Aug 27 01:38:08.099156 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 557/1173] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:38:07 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:38:09.115485 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-199e4fc0-2550-4595-a269-6c88d128c41b tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:09.116211 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-199e4fc0-2550-4595-a269-6c88d128c41b tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:09.122220 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-199e4fc0-2550-4595-a269-6c88d128c41b tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:09.122730 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-199e4fc0-2550-4595-a269-6c88d128c41b tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:09.123555 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-199e4fc0-2550-4595-a269-6c88d128c41b tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:09.123992 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-199e4fc0-2550-4595-a269-6c88d128c41b tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:09.202813 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-199e4fc0-2550-4595-a269-6c88d128c41b tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34172ab8bb0942fda2a6aeda56a3bf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c906f0891a04908acd7dc34d1953279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:38:09.212188 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-199e4fc0-2550-4595-a269-6c88d128c41b tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 200 len: 1512 microversion: 2.1 time: 0.100850 Aug 27 01:38:09.212748 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 617/1174] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:38:09 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 1512 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:38:09.216175 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-2f3a891e-6be1-48e5-a0c2-f7dc0589c8cc req-8a39f9d5-8323-438f-9b4e-d5266e0cc9be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05daee4f-8e0c-4b0f-955f-09527893b2fa", "name": "network-vif-deleted", "tag": "ecfa3830-4bf2-43df-94c3-c0d06632b36e"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:38:09.217078 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:38:09.217078 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:38:09.223992 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-2f3a891e-6be1-48e5-a0c2-f7dc0589c8cc req-8a39f9d5-8323-438f-9b4e-d5266e0cc9be service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:09.224723 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-2f3a891e-6be1-48e5-a0c2-f7dc0589c8cc req-8a39f9d5-8323-438f-9b4e-d5266e0cc9be service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:09.236246 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-2f3a891e-6be1-48e5-a0c2-f7dc0589c8cc req-8a39f9d5-8323-438f-9b4e-d5266e0cc9be service nova] Creating event network-vif-deleted:ecfa3830-4bf2-43df-94c3-c0d06632b36e for instance 05daee4f-8e0c-4b0f-955f-09527893b2fa on hv-cinder-75916 Aug 27 01:38:09.242032 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-2f3a891e-6be1-48e5-a0c2-f7dc0589c8cc req-8a39f9d5-8323-438f-9b4e-d5266e0cc9be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030107 Aug 27 01:38:09.242609 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 558/1175] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:38:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:38:10.228697 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-f66ddb98-9992-4410-8515-7aec55ed8fe6 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:10.229919 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-f66ddb98-9992-4410-8515-7aec55ed8fe6 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] [instance: 05daee4f-8e0c-4b0f-955f-09527893b2fa] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:10.236082 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f66ddb98-9992-4410-8515-7aec55ed8fe6 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:10.236525 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f66ddb98-9992-4410-8515-7aec55ed8fe6 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:10.237574 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f66ddb98-9992-4410-8515-7aec55ed8fe6 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:10.238212 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f66ddb98-9992-4410-8515-7aec55ed8fe6 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:10.257267 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.wsgi [None req-f66ddb98-9992-4410-8515-7aec55ed8fe6 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] HTTP exception thrown: Instance 05daee4f-8e0c-4b0f-955f-09527893b2fa could not be found. Aug 27 01:38:10.257267 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-f66ddb98-9992-4410-8515-7aec55ed8fe6 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Returning 404 to user: Instance 05daee4f-8e0c-4b0f-955f-09527893b2fa could not be found. {{(pid=108755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:38:10.257267 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-f66ddb98-9992-4410-8515-7aec55ed8fe6 tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa" status: 404 len: 111 microversion: 2.1 time: 0.029100 Aug 27 01:38:10.257267 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 618/1176] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:38:10 2021] GET /compute/v2.1/servers/05daee4f-8e0c-4b0f-955f-09527893b2fa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:38:10.266305 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-408d7507-de86-4884-b5fa-8ea3ffb175ad tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] Calling method '.version_select at 0x7ff217eacee0>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:10.353394 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-408d7507-de86-4884-b5fa-8ea3ffb175ad tempest-TestMinimumBasicScenario-223115890 tempest-TestMinimumBasicScenario-223115890-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-900072175" status: 202 len: 0 microversion: 2.1 time: 0.093186 Aug 27 01:38:10.353973 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 559/1177] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Aug 27 01:38:10 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-900072175 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:38:12.244386 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-fd581a2a-d7b1-44b0-915a-1e3e7c2f7b97 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:12.252569 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-fd581a2a-d7b1-44b0-915a-1e3e7c2f7b97 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:12.252569 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fd581a2a-d7b1-44b0-915a-1e3e7c2f7b97 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:12.252569 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fd581a2a-d7b1-44b0-915a-1e3e7c2f7b97 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:12.253217 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fd581a2a-d7b1-44b0-915a-1e3e7c2f7b97 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:12.253656 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fd581a2a-d7b1-44b0-915a-1e3e7c2f7b97 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:12.283979 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-fd581a2a-d7b1-44b0-915a-1e3e7c2f7b97 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044571 Aug 27 01:38:12.284536 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 619/1178] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Aug 27 01:38:12 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:38:12.362392 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-f6dc3fe6-c58a-4cbc-a04a-17cb2fedc482 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:12.363174 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-f6dc3fe6-c58a-4cbc-a04a-17cb2fedc482 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:12.370573 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f6dc3fe6-c58a-4cbc-a04a-17cb2fedc482 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:12.371022 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f6dc3fe6-c58a-4cbc-a04a-17cb2fedc482 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:12.371800 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f6dc3fe6-c58a-4cbc-a04a-17cb2fedc482 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:12.372732 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f6dc3fe6-c58a-4cbc-a04a-17cb2fedc482 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:12.402465 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-f6dc3fe6-c58a-4cbc-a04a-17cb2fedc482 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Going to try to terminate instance {{(pid=108756) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 01:38:12.767345 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-f6dc3fe6-c58a-4cbc-a04a-17cb2fedc482 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 204 len: 0 microversion: 2.20 time: 0.408775 Aug 27 01:38:12.767964 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 560/1179] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Aug 27 01:38:12 2021] DELETE /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 01:38:12.776589 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4e330bed-9ab2-438b-b68d-2183116db26a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:12.778425 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4e330bed-9ab2-438b-b68d-2183116db26a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:12.785122 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4e330bed-9ab2-438b-b68d-2183116db26a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:12.785670 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4e330bed-9ab2-438b-b68d-2183116db26a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:12.787162 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4e330bed-9ab2-438b-b68d-2183116db26a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:12.787910 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4e330bed-9ab2-438b-b68d-2183116db26a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:12.938380 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4e330bed-9ab2-438b-b68d-2183116db26a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:38:12.946508 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4e330bed-9ab2-438b-b68d-2183116db26a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:38:12.948230 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4e330bed-9ab2-438b-b68d-2183116db26a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:38:12.949384 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4e330bed-9ab2-438b-b68d-2183116db26a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1723 microversion: 2.20 time: 0.176298 Aug 27 01:38:12.949943 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 620/1180] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:38:12 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:38:13.969384 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-125d354f-6e5b-4a47-a375-f100be05d070 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:13.970088 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-125d354f-6e5b-4a47-a375-f100be05d070 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:13.976375 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-125d354f-6e5b-4a47-a375-f100be05d070 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:13.976818 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-125d354f-6e5b-4a47-a375-f100be05d070 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:13.977848 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-125d354f-6e5b-4a47-a375-f100be05d070 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:13.978277 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-125d354f-6e5b-4a47-a375-f100be05d070 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:14.203758 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-125d354f-6e5b-4a47-a375-f100be05d070 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:38:14.216209 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-125d354f-6e5b-4a47-a375-f100be05d070 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:38:14.218405 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-125d354f-6e5b-4a47-a375-f100be05d070 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:38:14.221099 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-125d354f-6e5b-4a47-a375-f100be05d070 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1723 microversion: 2.20 time: 0.255954 Aug 27 01:38:14.222308 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 561/1181] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:38:13 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 01:38:15.239762 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-5d170744-2ffb-45d1-8267-1105aaac401a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:15.241012 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-5d170744-2ffb-45d1-8267-1105aaac401a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:15.247293 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5d170744-2ffb-45d1-8267-1105aaac401a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:15.247742 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5d170744-2ffb-45d1-8267-1105aaac401a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:15.248523 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5d170744-2ffb-45d1-8267-1105aaac401a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:15.249068 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5d170744-2ffb-45d1-8267-1105aaac401a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:15.370469 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-5d170744-2ffb-45d1-8267-1105aaac401a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:38:15.386319 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-5d170744-2ffb-45d1-8267-1105aaac401a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:38:15.389907 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-5d170744-2ffb-45d1-8267-1105aaac401a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9032bdd7ffde4d3f9b500974a4c17c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe428e1f9c456087aa6ec677fe0330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:38:15.391391 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-5d170744-2ffb-45d1-8267-1105aaac401a tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 200 len: 1655 microversion: 2.20 time: 0.155940 Aug 27 01:38:15.392870 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 621/1182] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:38:15 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 1655 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 01:38:15.577043 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-27442de8-2b3f-400d-af21-1340fa087522 req-3dcea89b-c4a7-4ef0-a61e-a7b1f6be2731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b8f116a-f7c5-4c53-83b6-22034d528599", "name": "network-vif-deleted", "tag": "39c29f7a-a8f4-47b8-b7f9-8153941ce167"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:38:15.580244 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:38:15.580244 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:38:15.599456 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-27442de8-2b3f-400d-af21-1340fa087522 req-3dcea89b-c4a7-4ef0-a61e-a7b1f6be2731 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:15.600266 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-27442de8-2b3f-400d-af21-1340fa087522 req-3dcea89b-c4a7-4ef0-a61e-a7b1f6be2731 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:15.633902 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-27442de8-2b3f-400d-af21-1340fa087522 req-3dcea89b-c4a7-4ef0-a61e-a7b1f6be2731 service nova] Creating event network-vif-deleted:39c29f7a-a8f4-47b8-b7f9-8153941ce167 for instance 3b8f116a-f7c5-4c53-83b6-22034d528599 on hv-cinder-75916 Aug 27 01:38:15.633902 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-27442de8-2b3f-400d-af21-1340fa087522 req-3dcea89b-c4a7-4ef0-a61e-a7b1f6be2731 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060417 Aug 27 01:38:15.639537 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 562/1183] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:38:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:38:16.413246 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-84961bd6-8393-400e-993f-d3827df5758e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:16.414404 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-84961bd6-8393-400e-993f-d3827df5758e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:16.421507 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-84961bd6-8393-400e-993f-d3827df5758e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:16.421967 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-84961bd6-8393-400e-993f-d3827df5758e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:16.422776 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-84961bd6-8393-400e-993f-d3827df5758e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:16.423604 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-84961bd6-8393-400e-993f-d3827df5758e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:16.438425 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.wsgi [None req-84961bd6-8393-400e-993f-d3827df5758e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] HTTP exception thrown: Instance 3b8f116a-f7c5-4c53-83b6-22034d528599 could not be found. Aug 27 01:38:16.439160 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-84961bd6-8393-400e-993f-d3827df5758e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Returning 404 to user: Instance 3b8f116a-f7c5-4c53-83b6-22034d528599 could not be found. {{(pid=108755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:38:16.440222 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-84961bd6-8393-400e-993f-d3827df5758e tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 404 len: 111 microversion: 2.20 time: 0.033065 Aug 27 01:38:16.440890 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 622/1184] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Aug 27 01:38:16 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 01:38:16.451063 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c1a4ddfe-21bf-4d94-ac37-7a94eee2a429 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '.version_select at 0x7ff217e7cf70>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:16.541145 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c1a4ddfe-21bf-4d94-ac37-7a94eee2a429 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-974593180" status: 204 len: 0 microversion: 2.20 time: 0.094318 Aug 27 01:38:16.541887 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 563/1185] 10.222.0.25 () {60 vars in 1259 bytes} [Fri Aug 27 01:38:16 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-974593180 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 01:38:20.994076 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b32e82a8-6c52-415c-babd-9d268523f6eb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:20.994621 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b32e82a8-6c52-415c-babd-9d268523f6eb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:21.000514 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b32e82a8-6c52-415c-babd-9d268523f6eb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:21.006638 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b32e82a8-6c52-415c-babd-9d268523f6eb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:21.006638 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b32e82a8-6c52-415c-babd-9d268523f6eb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:21.006638 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b32e82a8-6c52-415c-babd-9d268523f6eb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:21.017712 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.wsgi [None req-b32e82a8-6c52-415c-babd-9d268523f6eb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] HTTP exception thrown: Instance 3b8f116a-f7c5-4c53-83b6-22034d528599 could not be found. Aug 27 01:38:21.018706 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b32e82a8-6c52-415c-babd-9d268523f6eb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Returning 404 to user: Instance 3b8f116a-f7c5-4c53-83b6-22034d528599 could not be found. {{(pid=108755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:38:21.019285 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b32e82a8-6c52-415c-babd-9d268523f6eb tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 404 len: 111 microversion: 2.1 time: 0.028812 Aug 27 01:38:21.019819 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 623/1186] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Aug 27 01:38:20 2021] DELETE /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:38:21.028294 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-703e4881-bdf1-4b1e-a956-c0ba0061f4d8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:21.029212 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-703e4881-bdf1-4b1e-a956-c0ba0061f4d8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 3b8f116a-f7c5-4c53-83b6-22034d528599] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:21.035203 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-703e4881-bdf1-4b1e-a956-c0ba0061f4d8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:21.035830 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-703e4881-bdf1-4b1e-a956-c0ba0061f4d8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:21.036800 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-703e4881-bdf1-4b1e-a956-c0ba0061f4d8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:21.037267 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-703e4881-bdf1-4b1e-a956-c0ba0061f4d8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:21.051905 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.wsgi [None req-703e4881-bdf1-4b1e-a956-c0ba0061f4d8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] HTTP exception thrown: Instance 3b8f116a-f7c5-4c53-83b6-22034d528599 could not be found. Aug 27 01:38:21.052503 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-703e4881-bdf1-4b1e-a956-c0ba0061f4d8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Returning 404 to user: Instance 3b8f116a-f7c5-4c53-83b6-22034d528599 could not be found. {{(pid=108756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:38:21.053430 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-703e4881-bdf1-4b1e-a956-c0ba0061f4d8 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599" status: 404 len: 111 microversion: 2.1 time: 0.028919 Aug 27 01:38:21.054121 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 564/1187] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:38:21 2021] GET /compute/v2.1/servers/3b8f116a-f7c5-4c53-83b6-22034d528599 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 01:38:22.409298 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-78b11877-10c8-4f58-bbca-72471eeff1b9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:22.409947 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-78b11877-10c8-4f58-bbca-72471eeff1b9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:22.419429 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-78b11877-10c8-4f58-bbca-72471eeff1b9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:22.419954 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-78b11877-10c8-4f58-bbca-72471eeff1b9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:22.420812 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-78b11877-10c8-4f58-bbca-72471eeff1b9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:22.421561 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-78b11877-10c8-4f58-bbca-72471eeff1b9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:22.441896 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.wsgi [None req-78b11877-10c8-4f58-bbca-72471eeff1b9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] HTTP exception thrown: Instance 6ec83298-8a1e-4edd-be07-4e0592a0ce04 could not be found. Aug 27 01:38:22.442710 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-78b11877-10c8-4f58-bbca-72471eeff1b9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Returning 404 to user: Instance 6ec83298-8a1e-4edd-be07-4e0592a0ce04 could not be found. {{(pid=108755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:38:22.443872 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-78b11877-10c8-4f58-bbca-72471eeff1b9 tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 404 len: 111 microversion: 2.1 time: 0.040799 Aug 27 01:38:22.444602 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 624/1188] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Aug 27 01:38:22 2021] DELETE /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:38:22.453175 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-1135c4b9-2639-4446-a1bc-4d91bde6aa6b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:22.453932 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-1135c4b9-2639-4446-a1bc-4d91bde6aa6b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] [instance: 6ec83298-8a1e-4edd-be07-4e0592a0ce04] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:22.460652 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1135c4b9-2639-4446-a1bc-4d91bde6aa6b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:22.460652 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1135c4b9-2639-4446-a1bc-4d91bde6aa6b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:22.464474 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1135c4b9-2639-4446-a1bc-4d91bde6aa6b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:22.464474 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-1135c4b9-2639-4446-a1bc-4d91bde6aa6b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:22.475502 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.wsgi [None req-1135c4b9-2639-4446-a1bc-4d91bde6aa6b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] HTTP exception thrown: Instance 6ec83298-8a1e-4edd-be07-4e0592a0ce04 could not be found. Aug 27 01:38:22.476169 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-1135c4b9-2639-4446-a1bc-4d91bde6aa6b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] Returning 404 to user: Instance 6ec83298-8a1e-4edd-be07-4e0592a0ce04 could not be found. {{(pid=108756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:38:22.477026 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-1135c4b9-2639-4446-a1bc-4d91bde6aa6b tempest-AttachVolumeShelveTestJSON-1674156645 tempest-AttachVolumeShelveTestJSON-1674156645-project] 10.222.0.25 "GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04" status: 404 len: 111 microversion: 2.1 time: 0.027487 Aug 27 01:38:22.477560 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 565/1189] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:38:22 2021] GET /compute/v2.1/servers/6ec83298-8a1e-4edd-be07-4e0592a0ce04 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:38:29.620229 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4cb93318-c846-4f45-93db-1befc4811ef3 tempest-VolumesNegativeTest-1336421945 tempest-VolumesNegativeTest-1336421945-project] Action: 'create', calling method: .version_select at 0x7ff21419bc10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-128491762", "metadata": {"Type": "work"}}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:38:29.640375 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4cb93318-c846-4f45-93db-1befc4811ef3 tempest-VolumesNegativeTest-1336421945 tempest-VolumesNegativeTest-1336421945-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=108755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:38:29.640375 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4cb93318-c846-4f45-93db-1befc4811ef3 tempest-VolumesNegativeTest-1336421945 tempest-VolumesNegativeTest-1336421945-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.138311 Aug 27 01:38:29.640375 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 625/1190] 10.222.0.25 () {60 vars in 1156 bytes} [Fri Aug 27 01:38:29 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 01:38:29.640688 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-1299ef68-8402-45d6-9da9-e90d7b9077ab tempest-VolumesNegativeTest-1336421945 tempest-VolumesNegativeTest-1336421945-project] Action: 'create', calling method: .version_select at 0x7ff217e04430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1526141519", "metadata": {"Type": "work"}}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:38:29.640688 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-1299ef68-8402-45d6-9da9-e90d7b9077ab tempest-VolumesNegativeTest-1336421945 tempest-VolumesNegativeTest-1336421945-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=108756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:38:29.640688 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-1299ef68-8402-45d6-9da9-e90d7b9077ab tempest-VolumesNegativeTest-1336421945 tempest-VolumesNegativeTest-1336421945-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006617 Aug 27 01:38:29.640688 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 566/1191] 10.222.0.25 () {60 vars in 1156 bytes} [Fri Aug 27 01:38:29 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 01:38:29.644804 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-ec430a54-53bd-42b3-a793-da166cb84066 tempest-VolumesNegativeTest-1336421945 tempest-VolumesNegativeTest-1336421945-project] Action: 'create', calling method: .version_select at 0x7ff2141bdee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-543394607", "metadata": {"Type": "work"}}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:38:29.646070 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-ec430a54-53bd-42b3-a793-da166cb84066 tempest-VolumesNegativeTest-1336421945 tempest-VolumesNegativeTest-1336421945-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=108755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:38:29.646859 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-ec430a54-53bd-42b3-a793-da166cb84066 tempest-VolumesNegativeTest-1336421945 tempest-VolumesNegativeTest-1336421945-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005748 Aug 27 01:38:29.647364 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 626/1192] 10.222.0.25 () {60 vars in 1156 bytes} [Fri Aug 27 01:38:29 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 01:38:29.656049 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-04a52b2f-1828-4db7-b4b3-bc09bef9fbf9 tempest-VolumesNegativeTest-1336421945 tempest-VolumesNegativeTest-1336421945-project] Calling method '.version_select at 0x7ff2142721f0>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:29.688526 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.wsgi [None req-04a52b2f-1828-4db7-b4b3-bc09bef9fbf9 tempest-VolumesNegativeTest-1336421945 tempest-VolumesNegativeTest-1336421945-project] HTTP exception thrown: Volume tempest-invalid-1191176796 could not be found. Aug 27 01:38:29.688526 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-04a52b2f-1828-4db7-b4b3-bc09bef9fbf9 tempest-VolumesNegativeTest-1336421945 tempest-VolumesNegativeTest-1336421945-project] Returning 404 to user: Volume tempest-invalid-1191176796 could not be found. {{(pid=108756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:38:29.688526 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-04a52b2f-1828-4db7-b4b3-bc09bef9fbf9 tempest-VolumesNegativeTest-1336421945 tempest-VolumesNegativeTest-1336421945-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1191176796" status: 404 len: 99 microversion: 2.1 time: 0.035239 Aug 27 01:38:29.688526 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 567/1193] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Aug 27 01:38:29 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1191176796 => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 01:38:29.698552 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-9ebbdbd5-8f9a-48b4-a40d-17eed1fd8507 tempest-VolumesNegativeTest-1336421945 tempest-VolumesNegativeTest-1336421945-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004515 Aug 27 01:38:29.699050 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 627/1194] 10.222.0.25 () {58 vars in 1140 bytes} [Fri Aug 27 01:38:29 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 01:38:29.708736 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-396a3b1e-d773-4d1d-8179-ae99a83281db tempest-VolumesNegativeTest-1336421945 tempest-VolumesNegativeTest-1336421945-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004332 Aug 27 01:38:29.709279 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 568/1195] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Aug 27 01:38:29 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 01:38:29.726319 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-9d67a227-80bc-499b-9a53-989de772f45c tempest-VolumesNegativeTest-1336421945 tempest-VolumesNegativeTest-1336421945-project] Calling method '.version_select at 0x7ff2141b1f70>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:29.756974 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.wsgi [None req-9d67a227-80bc-499b-9a53-989de772f45c tempest-VolumesNegativeTest-1336421945 tempest-VolumesNegativeTest-1336421945-project] HTTP exception thrown: Volume 59898a4c-ff17-4146-a56d-f7d4f8ee2327 could not be found. Aug 27 01:38:29.756974 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-9d67a227-80bc-499b-9a53-989de772f45c tempest-VolumesNegativeTest-1336421945 tempest-VolumesNegativeTest-1336421945-project] Returning 404 to user: Volume 59898a4c-ff17-4146-a56d-f7d4f8ee2327 could not be found. {{(pid=108755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:38:29.757348 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-9d67a227-80bc-499b-9a53-989de772f45c tempest-VolumesNegativeTest-1336421945 tempest-VolumesNegativeTest-1336421945-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/59898a4c-ff17-4146-a56d-f7d4f8ee2327" status: 404 len: 109 microversion: 2.1 time: 0.040949 Aug 27 01:38:29.757877 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 628/1196] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Aug 27 01:38:29 2021] DELETE /compute/v2.1/os-volumes/59898a4c-ff17-4146-a56d-f7d4f8ee2327 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:38:29.767268 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-a3101e4d-b57d-4710-912f-93e52f679b73 tempest-VolumesNegativeTest-1336421945 tempest-VolumesNegativeTest-1336421945-project] Calling method '.version_select at 0x7ff217e04430>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:29.799695 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.wsgi [None req-a3101e4d-b57d-4710-912f-93e52f679b73 tempest-VolumesNegativeTest-1336421945 tempest-VolumesNegativeTest-1336421945-project] HTTP exception thrown: Volume 63daa76c-f541-40bd-80dd-06a9ab99a214 could not be found. Aug 27 01:38:29.800179 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-a3101e4d-b57d-4710-912f-93e52f679b73 tempest-VolumesNegativeTest-1336421945 tempest-VolumesNegativeTest-1336421945-project] Returning 404 to user: Volume 63daa76c-f541-40bd-80dd-06a9ab99a214 could not be found. {{(pid=108756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:38:29.801700 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-a3101e4d-b57d-4710-912f-93e52f679b73 tempest-VolumesNegativeTest-1336421945 tempest-VolumesNegativeTest-1336421945-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/63daa76c-f541-40bd-80dd-06a9ab99a214" status: 404 len: 109 microversion: 2.1 time: 0.037664 Aug 27 01:38:29.802234 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 569/1197] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Aug 27 01:38:29 2021] GET /compute/v2.1/os-volumes/63daa76c-f541-40bd-80dd-06a9ab99a214 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 01:38:37.907009 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-07902d79-00b6-44a9-b754-2fb9a6ab04ab tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Action: 'create', calling method: .version_select at 0x7ff21417b9d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1454714052"}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:38:37.927228 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-07902d79-00b6-44a9-b754-2fb9a6ab04ab tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Getting quotas for project d683ea4300b545fda6f56b5c11ee189c. Resources: {'key_pairs'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:38:37.931231 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-07902d79-00b6-44a9-b754-2fb9a6ab04ab tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Getting quotas for user ded8a106d4d64603a7c87306eae430b7 and project d683ea4300b545fda6f56b5c11ee189c. Resources: {'key_pairs'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:38:38.291662 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-07902d79-00b6-44a9-b754-2fb9a6ab04ab tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Getting quotas for project d683ea4300b545fda6f56b5c11ee189c. Resources: {'key_pairs'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:38:38.296471 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-07902d79-00b6-44a9-b754-2fb9a6ab04ab tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Getting quotas for user ded8a106d4d64603a7c87306eae430b7 and project d683ea4300b545fda6f56b5c11ee189c. Resources: {'key_pairs'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:38:38.312819 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-07902d79-00b6-44a9-b754-2fb9a6ab04ab tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.596982 Aug 27 01:38:38.319282 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 629/1198] 10.222.0.25 () {60 vars in 1158 bytes} [Fri Aug 27 01:38:37 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:38:39.493148 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-fea5ed50-41b5-4aaf-a2e6-8aefe7d0943c tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-457308300", "imageRef": "6660bea6-dee9-43b4-95ef-29b53e1a2b28", "flavorRef": "452"}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:38:39.545188 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.network.neutron [None req-fea5ed50-41b5-4aaf-a2e6-8aefe7d0943c tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] validate_networks() for None {{(pid=108756) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 01:38:39.835482 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-fea5ed50-41b5-4aaf-a2e6-8aefe7d0943c tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Flavor limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 01:38:39.835896 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-fea5ed50-41b5-4aaf-a2e6-8aefe7d0943c tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Image limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 01:38:39.836574 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-fea5ed50-41b5-4aaf-a2e6-8aefe7d0943c tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Flavor pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 01:38:39.837007 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-fea5ed50-41b5-4aaf-a2e6-8aefe7d0943c tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Image pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 01:38:39.837560 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-fea5ed50-41b5-4aaf-a2e6-8aefe7d0943c tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 01:38:39.846625 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fea5ed50-41b5-4aaf-a2e6-8aefe7d0943c tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:39.847073 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fea5ed50-41b5-4aaf-a2e6-8aefe7d0943c tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:39.848551 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fea5ed50-41b5-4aaf-a2e6-8aefe7d0943c tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:39.849162 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fea5ed50-41b5-4aaf-a2e6-8aefe7d0943c tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:39.866091 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-fea5ed50-41b5-4aaf-a2e6-8aefe7d0943c tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Getting quotas for project d72e10657fb743329337e869d71860f6. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:38:39.870015 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-fea5ed50-41b5-4aaf-a2e6-8aefe7d0943c tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Getting quotas for user 6373463a7b8e4a0c96d35aa88b16cd9b and project d72e10657fb743329337e869d71860f6. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:38:39.881315 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-fea5ed50-41b5-4aaf-a2e6-8aefe7d0943c tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Going to run 1 instances... {{(pid=108756) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 01:38:39.883595 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-fea5ed50-41b5-4aaf-a2e6-8aefe7d0943c tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] [instance: 7ea59999-142b-4eda-81ac-a1d6b5cd40d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6660bea6-dee9-43b4-95ef-29b53e1a2b28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 01:38:40.031090 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-fea5ed50-41b5-4aaf-a2e6-8aefe7d0943c tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543035 Aug 27 01:38:40.037457 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 570/1199] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Aug 27 01:38:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 01:38:40.041950 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-94e68703-608d-4431-ac2f-78ae7f5c55a7 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:40.042559 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-94e68703-608d-4431-ac2f-78ae7f5c55a7 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] [instance: 7ea59999-142b-4eda-81ac-a1d6b5cd40d6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:40.107959 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-94e68703-608d-4431-ac2f-78ae7f5c55a7 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6373463a7b8e4a0c96d35aa88b16cd9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72e10657fb743329337e869d71860f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:38:40.124119 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-94e68703-608d-4431-ac2f-78ae7f5c55a7 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] 10.222.0.25 "GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6" status: 200 len: 1214 microversion: 2.1 time: 0.077437 Aug 27 01:38:40.124119 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 630/1200] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:38:40 2021] GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:38:41.132851 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-265ee6fe-6180-4736-b1c8-5c5c39cccd65 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:41.133584 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-265ee6fe-6180-4736-b1c8-5c5c39cccd65 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] [instance: 7ea59999-142b-4eda-81ac-a1d6b5cd40d6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:41.141103 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-265ee6fe-6180-4736-b1c8-5c5c39cccd65 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:41.141937 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-265ee6fe-6180-4736-b1c8-5c5c39cccd65 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:41.142854 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-265ee6fe-6180-4736-b1c8-5c5c39cccd65 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:41.143771 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-265ee6fe-6180-4736-b1c8-5c5c39cccd65 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:41.206516 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-265ee6fe-6180-4736-b1c8-5c5c39cccd65 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6373463a7b8e4a0c96d35aa88b16cd9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72e10657fb743329337e869d71860f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:38:41.214539 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-265ee6fe-6180-4736-b1c8-5c5c39cccd65 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] 10.222.0.25 "GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6" status: 200 len: 1218 microversion: 2.1 time: 0.085851 Aug 27 01:38:41.215126 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 571/1201] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:38:41 2021] GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:38:42.231388 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-bab050de-a727-4232-964c-954fccfcb63b tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:42.232118 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-bab050de-a727-4232-964c-954fccfcb63b tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] [instance: 7ea59999-142b-4eda-81ac-a1d6b5cd40d6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:42.238455 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bab050de-a727-4232-964c-954fccfcb63b tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:42.239279 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bab050de-a727-4232-964c-954fccfcb63b tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:42.240484 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bab050de-a727-4232-964c-954fccfcb63b tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:42.241171 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bab050de-a727-4232-964c-954fccfcb63b tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:42.307701 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-bab050de-a727-4232-964c-954fccfcb63b tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6373463a7b8e4a0c96d35aa88b16cd9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72e10657fb743329337e869d71860f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:38:42.315436 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-bab050de-a727-4232-964c-954fccfcb63b tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] 10.222.0.25 "GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6" status: 200 len: 1266 microversion: 2.1 time: 0.087760 Aug 27 01:38:42.316120 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 631/1202] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:38:42 2021] GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:38:43.334260 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-30d5c4d6-e775-4c8e-998e-1d17c7a04fbd tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:43.334870 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-30d5c4d6-e775-4c8e-998e-1d17c7a04fbd tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] [instance: 7ea59999-142b-4eda-81ac-a1d6b5cd40d6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:43.341477 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-30d5c4d6-e775-4c8e-998e-1d17c7a04fbd tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:43.341975 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-30d5c4d6-e775-4c8e-998e-1d17c7a04fbd tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:43.344777 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-30d5c4d6-e775-4c8e-998e-1d17c7a04fbd tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:43.345309 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-30d5c4d6-e775-4c8e-998e-1d17c7a04fbd tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:43.409824 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-30d5c4d6-e775-4c8e-998e-1d17c7a04fbd tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6373463a7b8e4a0c96d35aa88b16cd9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72e10657fb743329337e869d71860f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:38:43.417486 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-30d5c4d6-e775-4c8e-998e-1d17c7a04fbd tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] 10.222.0.25 "GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6" status: 200 len: 1272 microversion: 2.1 time: 0.088514 Aug 27 01:38:43.418056 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 572/1203] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:38:43 2021] GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6 => generated 1272 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:38:44.439673 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d2ae281b-e501-49d9-8e40-5d25ae7a130d tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:44.440522 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d2ae281b-e501-49d9-8e40-5d25ae7a130d tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] [instance: 7ea59999-142b-4eda-81ac-a1d6b5cd40d6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:44.449922 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d2ae281b-e501-49d9-8e40-5d25ae7a130d tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:44.450793 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d2ae281b-e501-49d9-8e40-5d25ae7a130d tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:44.451889 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d2ae281b-e501-49d9-8e40-5d25ae7a130d tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:44.452524 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d2ae281b-e501-49d9-8e40-5d25ae7a130d tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:44.668540 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d2ae281b-e501-49d9-8e40-5d25ae7a130d tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6373463a7b8e4a0c96d35aa88b16cd9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72e10657fb743329337e869d71860f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:38:44.676473 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d2ae281b-e501-49d9-8e40-5d25ae7a130d tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] 10.222.0.25 "GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6" status: 200 len: 1314 microversion: 2.1 time: 0.240379 Aug 27 01:38:44.677361 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 632/1204] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:38:44 2021] GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:38:45.080725 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-b1069720-4d20-4407-b908-c43258cf89b8 req-8ffcc491-08fa-45af-855f-701d72560343 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ea59999-142b-4eda-81ac-a1d6b5cd40d6", "tag": "4e1d7583-ac79-4bed-899f-93599ca917aa"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:38:45.084347 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:38:45.084347 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:38:45.091934 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-b1069720-4d20-4407-b908-c43258cf89b8 req-8ffcc491-08fa-45af-855f-701d72560343 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:45.092757 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-b1069720-4d20-4407-b908-c43258cf89b8 req-8ffcc491-08fa-45af-855f-701d72560343 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:45.110032 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-b1069720-4d20-4407-b908-c43258cf89b8 req-8ffcc491-08fa-45af-855f-701d72560343 service nova] Creating event network-changed:4e1d7583-ac79-4bed-899f-93599ca917aa for instance 7ea59999-142b-4eda-81ac-a1d6b5cd40d6 on hv-cinder-75916 Aug 27 01:38:45.115295 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-b1069720-4d20-4407-b908-c43258cf89b8 req-8ffcc491-08fa-45af-855f-701d72560343 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039266 Aug 27 01:38:45.116040 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 573/1205] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:38:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:38:45.694244 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-1f3ef2a0-6969-45ff-8feb-9d80564bc43c tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:45.695355 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-1f3ef2a0-6969-45ff-8feb-9d80564bc43c tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] [instance: 7ea59999-142b-4eda-81ac-a1d6b5cd40d6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:45.701753 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1f3ef2a0-6969-45ff-8feb-9d80564bc43c tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:45.702420 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1f3ef2a0-6969-45ff-8feb-9d80564bc43c tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:45.703378 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1f3ef2a0-6969-45ff-8feb-9d80564bc43c tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:45.703811 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1f3ef2a0-6969-45ff-8feb-9d80564bc43c tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:45.890723 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-1f3ef2a0-6969-45ff-8feb-9d80564bc43c tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6373463a7b8e4a0c96d35aa88b16cd9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72e10657fb743329337e869d71860f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:38:45.898522 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-1f3ef2a0-6969-45ff-8feb-9d80564bc43c tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] 10.222.0.25 "GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6" status: 200 len: 1314 microversion: 2.1 time: 0.208678 Aug 27 01:38:45.899094 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 633/1206] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:38:45 2021] GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:38:46.915010 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-65123893-7596-4a3e-a364-25c10da925c5 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:46.915706 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-65123893-7596-4a3e-a364-25c10da925c5 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] [instance: 7ea59999-142b-4eda-81ac-a1d6b5cd40d6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:46.921839 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-65123893-7596-4a3e-a364-25c10da925c5 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:46.922284 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-65123893-7596-4a3e-a364-25c10da925c5 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:46.923437 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-65123893-7596-4a3e-a364-25c10da925c5 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:46.923873 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-65123893-7596-4a3e-a364-25c10da925c5 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:47.049030 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-65123893-7596-4a3e-a364-25c10da925c5 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6373463a7b8e4a0c96d35aa88b16cd9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72e10657fb743329337e869d71860f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:38:47.056784 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-65123893-7596-4a3e-a364-25c10da925c5 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] 10.222.0.25 "GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6" status: 200 len: 1314 microversion: 2.1 time: 0.146342 Aug 27 01:38:47.059171 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 574/1207] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:38:46 2021] GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:38:48.073539 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-778847eb-0ad8-4c6e-a7bf-bcf029479d7f tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:48.074070 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-778847eb-0ad8-4c6e-a7bf-bcf029479d7f tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] [instance: 7ea59999-142b-4eda-81ac-a1d6b5cd40d6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:48.079871 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-778847eb-0ad8-4c6e-a7bf-bcf029479d7f tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:48.080314 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-778847eb-0ad8-4c6e-a7bf-bcf029479d7f tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:48.081111 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-778847eb-0ad8-4c6e-a7bf-bcf029479d7f tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:48.081547 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-778847eb-0ad8-4c6e-a7bf-bcf029479d7f tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:48.213655 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-778847eb-0ad8-4c6e-a7bf-bcf029479d7f tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6373463a7b8e4a0c96d35aa88b16cd9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72e10657fb743329337e869d71860f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:38:48.221124 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-778847eb-0ad8-4c6e-a7bf-bcf029479d7f tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] 10.222.0.25 "GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6" status: 200 len: 1314 microversion: 2.1 time: 0.151106 Aug 27 01:38:48.221734 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 634/1208] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:38:48 2021] GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:38:49.239986 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-7de89043-dd7b-46e5-a61b-d340a1631aaa tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:49.241328 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-7de89043-dd7b-46e5-a61b-d340a1631aaa tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] [instance: 7ea59999-142b-4eda-81ac-a1d6b5cd40d6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:49.247468 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7de89043-dd7b-46e5-a61b-d340a1631aaa tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:49.252263 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7de89043-dd7b-46e5-a61b-d340a1631aaa tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:49.252263 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7de89043-dd7b-46e5-a61b-d340a1631aaa tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:49.252263 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7de89043-dd7b-46e5-a61b-d340a1631aaa tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:49.374863 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-7de89043-dd7b-46e5-a61b-d340a1631aaa tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6373463a7b8e4a0c96d35aa88b16cd9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72e10657fb743329337e869d71860f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:38:49.382732 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-7de89043-dd7b-46e5-a61b-d340a1631aaa tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] 10.222.0.25 "GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6" status: 200 len: 1314 microversion: 2.1 time: 0.147816 Aug 27 01:38:49.383420 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 575/1209] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:38:49 2021] GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:38:50.399664 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b4db58c8-abc7-491a-b8c2-f10ed93b75d3 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:50.400458 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b4db58c8-abc7-491a-b8c2-f10ed93b75d3 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] [instance: 7ea59999-142b-4eda-81ac-a1d6b5cd40d6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:50.407029 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b4db58c8-abc7-491a-b8c2-f10ed93b75d3 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:50.407466 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b4db58c8-abc7-491a-b8c2-f10ed93b75d3 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:50.408231 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b4db58c8-abc7-491a-b8c2-f10ed93b75d3 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:50.408657 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b4db58c8-abc7-491a-b8c2-f10ed93b75d3 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:50.533866 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-b4db58c8-abc7-491a-b8c2-f10ed93b75d3 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6373463a7b8e4a0c96d35aa88b16cd9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72e10657fb743329337e869d71860f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:38:50.541484 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b4db58c8-abc7-491a-b8c2-f10ed93b75d3 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] 10.222.0.25 "GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6" status: 200 len: 1314 microversion: 2.1 time: 0.145820 Aug 27 01:38:50.545382 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 635/1210] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:38:50 2021] GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:38:50.839181 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-18c67e45-45a2-4bc2-a626-e5ca4559f772 req-bd8eb92f-765e-44e4-9cca-1e4c8aa82d38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ea59999-142b-4eda-81ac-a1d6b5cd40d6", "name": "network-vif-plugged", "status": "completed", "tag": "4e1d7583-ac79-4bed-899f-93599ca917aa"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:38:50.843647 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:38:50.843647 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:38:50.851281 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-18c67e45-45a2-4bc2-a626-e5ca4559f772 req-bd8eb92f-765e-44e4-9cca-1e4c8aa82d38 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:50.851666 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-18c67e45-45a2-4bc2-a626-e5ca4559f772 req-bd8eb92f-765e-44e4-9cca-1e4c8aa82d38 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:50.862514 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-18c67e45-45a2-4bc2-a626-e5ca4559f772 req-bd8eb92f-765e-44e4-9cca-1e4c8aa82d38 service nova] Creating event network-vif-plugged:4e1d7583-ac79-4bed-899f-93599ca917aa for instance 7ea59999-142b-4eda-81ac-a1d6b5cd40d6 on hv-cinder-75916 Aug 27 01:38:50.868329 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-18c67e45-45a2-4bc2-a626-e5ca4559f772 req-bd8eb92f-765e-44e4-9cca-1e4c8aa82d38 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032750 Aug 27 01:38:50.868940 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 576/1211] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:38:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:38:51.558499 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-f7eb1bb0-6a52-41b2-9b3f-e9d3802d4415 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:51.559118 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-f7eb1bb0-6a52-41b2-9b3f-e9d3802d4415 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] [instance: 7ea59999-142b-4eda-81ac-a1d6b5cd40d6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:51.565040 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f7eb1bb0-6a52-41b2-9b3f-e9d3802d4415 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:51.577433 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f7eb1bb0-6a52-41b2-9b3f-e9d3802d4415 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:51.577433 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f7eb1bb0-6a52-41b2-9b3f-e9d3802d4415 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:51.577433 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f7eb1bb0-6a52-41b2-9b3f-e9d3802d4415 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:51.697235 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-f7eb1bb0-6a52-41b2-9b3f-e9d3802d4415 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6373463a7b8e4a0c96d35aa88b16cd9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72e10657fb743329337e869d71860f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:38:51.704373 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-f7eb1bb0-6a52-41b2-9b3f-e9d3802d4415 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] 10.222.0.25 "GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6" status: 200 len: 1314 microversion: 2.1 time: 0.149655 Aug 27 01:38:51.705050 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 636/1212] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:38:51 2021] GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:38:52.724049 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-e8915aff-f618-447e-922f-e3851f92a9a6 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:52.724742 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-e8915aff-f618-447e-922f-e3851f92a9a6 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] [instance: 7ea59999-142b-4eda-81ac-a1d6b5cd40d6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:52.730970 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e8915aff-f618-447e-922f-e3851f92a9a6 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:52.731358 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e8915aff-f618-447e-922f-e3851f92a9a6 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:52.732125 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e8915aff-f618-447e-922f-e3851f92a9a6 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:52.732566 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e8915aff-f618-447e-922f-e3851f92a9a6 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:52.862816 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-e8915aff-f618-447e-922f-e3851f92a9a6 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6373463a7b8e4a0c96d35aa88b16cd9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72e10657fb743329337e869d71860f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:38:52.870855 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-e8915aff-f618-447e-922f-e3851f92a9a6 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] 10.222.0.25 "GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6" status: 200 len: 1463 microversion: 2.1 time: 0.151370 Aug 27 01:38:52.871442 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 577/1213] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:38:52 2021] GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6 => generated 1463 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:38:52.908651 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-7ee75148-c8db-4873-a9e7-2391cc2027f3 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:52.909197 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-7ee75148-c8db-4873-a9e7-2391cc2027f3 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] [instance: 7ea59999-142b-4eda-81ac-a1d6b5cd40d6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:52.915449 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7ee75148-c8db-4873-a9e7-2391cc2027f3 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:52.915898 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7ee75148-c8db-4873-a9e7-2391cc2027f3 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:52.916664 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7ee75148-c8db-4873-a9e7-2391cc2027f3 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:52.917135 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7ee75148-c8db-4873-a9e7-2391cc2027f3 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:52.941499 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-7ee75148-c8db-4873-a9e7-2391cc2027f3 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] [instance: 7ea59999-142b-4eda-81ac-a1d6b5cd40d6] Going to try to terminate instance {{(pid=108755) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 01:38:53.230723 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-7ee75148-c8db-4873-a9e7-2391cc2027f3 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6" status: 204 len: 0 microversion: 2.1 time: 0.325486 Aug 27 01:38:53.231299 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 637/1214] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Aug 27 01:38:52 2021] DELETE /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 01:38:53.240327 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-d6089c27-e353-4745-9706-fae7f6d7a58d tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:53.241784 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-d6089c27-e353-4745-9706-fae7f6d7a58d tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] [instance: 7ea59999-142b-4eda-81ac-a1d6b5cd40d6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:53.247766 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d6089c27-e353-4745-9706-fae7f6d7a58d tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:53.248219 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d6089c27-e353-4745-9706-fae7f6d7a58d tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:53.249031 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d6089c27-e353-4745-9706-fae7f6d7a58d tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:53.249470 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d6089c27-e353-4745-9706-fae7f6d7a58d tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:53.380750 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-d6089c27-e353-4745-9706-fae7f6d7a58d tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6373463a7b8e4a0c96d35aa88b16cd9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72e10657fb743329337e869d71860f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:38:53.389164 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-d6089c27-e353-4745-9706-fae7f6d7a58d tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] 10.222.0.25 "GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6" status: 200 len: 1469 microversion: 2.1 time: 0.151973 Aug 27 01:38:53.389164 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 578/1215] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:38:53 2021] GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6 => generated 1469 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:38:54.244952 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 01:38:54.245454 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: Fri Aug 27 01:38:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 01:38:54.408726 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-2d7d8ed7-e925-40e1-8d02-b6c2dacfcdad tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:54.409527 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-2d7d8ed7-e925-40e1-8d02-b6c2dacfcdad tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] [instance: 7ea59999-142b-4eda-81ac-a1d6b5cd40d6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:54.415727 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2d7d8ed7-e925-40e1-8d02-b6c2dacfcdad tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:54.416174 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2d7d8ed7-e925-40e1-8d02-b6c2dacfcdad tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:54.416970 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2d7d8ed7-e925-40e1-8d02-b6c2dacfcdad tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:54.417578 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2d7d8ed7-e925-40e1-8d02-b6c2dacfcdad tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:54.555959 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-2d7d8ed7-e925-40e1-8d02-b6c2dacfcdad tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6373463a7b8e4a0c96d35aa88b16cd9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72e10657fb743329337e869d71860f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:38:54.563757 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-2d7d8ed7-e925-40e1-8d02-b6c2dacfcdad tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] 10.222.0.25 "GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6" status: 200 len: 1469 microversion: 2.1 time: 0.161355 Aug 27 01:38:54.564312 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 638/1216] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:38:54 2021] GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6 => generated 1469 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:38:55.486270 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-9935c280-c934-423b-9723-53bb98e6712c req-9ee380f1-790e-40b6-9256-14b311d9eddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ea59999-142b-4eda-81ac-a1d6b5cd40d6", "name": "network-vif-deleted", "tag": "4e1d7583-ac79-4bed-899f-93599ca917aa"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:38:55.487923 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:38:55.487923 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:38:55.496859 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-9935c280-c934-423b-9723-53bb98e6712c req-9ee380f1-790e-40b6-9256-14b311d9eddd service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:55.497372 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-9935c280-c934-423b-9723-53bb98e6712c req-9ee380f1-790e-40b6-9256-14b311d9eddd service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:55.508924 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-9935c280-c934-423b-9723-53bb98e6712c req-9ee380f1-790e-40b6-9256-14b311d9eddd service nova] Creating event network-vif-deleted:4e1d7583-ac79-4bed-899f-93599ca917aa for instance 7ea59999-142b-4eda-81ac-a1d6b5cd40d6 on hv-cinder-75916 Aug 27 01:38:55.514408 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-9935c280-c934-423b-9723-53bb98e6712c req-9ee380f1-790e-40b6-9256-14b311d9eddd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032213 Aug 27 01:38:55.518233 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 579/1217] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:38:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:38:55.581276 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-e2f17035-69f0-4964-9561-e0a7cadefb06 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:55.583410 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-e2f17035-69f0-4964-9561-e0a7cadefb06 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] [instance: 7ea59999-142b-4eda-81ac-a1d6b5cd40d6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:55.588431 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e2f17035-69f0-4964-9561-e0a7cadefb06 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:55.588903 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e2f17035-69f0-4964-9561-e0a7cadefb06 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:55.590400 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e2f17035-69f0-4964-9561-e0a7cadefb06 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:55.590838 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e2f17035-69f0-4964-9561-e0a7cadefb06 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:55.656319 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-e2f17035-69f0-4964-9561-e0a7cadefb06 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6373463a7b8e4a0c96d35aa88b16cd9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72e10657fb743329337e869d71860f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:38:55.666101 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-e2f17035-69f0-4964-9561-e0a7cadefb06 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] 10.222.0.25 "GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6" status: 200 len: 1427 microversion: 2.1 time: 0.088383 Aug 27 01:38:55.666661 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 639/1218] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:38:55 2021] GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6 => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:38:56.683700 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-acdca0af-9aa6-4d48-8f00-9b4a95e15509 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:56.684305 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-acdca0af-9aa6-4d48-8f00-9b4a95e15509 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] [instance: 7ea59999-142b-4eda-81ac-a1d6b5cd40d6] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:56.690214 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-acdca0af-9aa6-4d48-8f00-9b4a95e15509 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:56.690659 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-acdca0af-9aa6-4d48-8f00-9b4a95e15509 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:56.691501 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-acdca0af-9aa6-4d48-8f00-9b4a95e15509 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:56.691992 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-acdca0af-9aa6-4d48-8f00-9b4a95e15509 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:56.724453 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-acdca0af-9aa6-4d48-8f00-9b4a95e15509 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:56.726714 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-acdca0af-9aa6-4d48-8f00-9b4a95e15509 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:56.726714 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.objects.instance [None req-acdca0af-9aa6-4d48-8f00-9b4a95e15509 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lazy-loading 'fault' on Instance uuid 7ea59999-142b-4eda-81ac-a1d6b5cd40d6 {{(pid=108756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:38:56.767146 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-acdca0af-9aa6-4d48-8f00-9b4a95e15509 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6373463a7b8e4a0c96d35aa88b16cd9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72e10657fb743329337e869d71860f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:38:56.773763 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-acdca0af-9aa6-4d48-8f00-9b4a95e15509 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] 10.222.0.25 "GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6" status: 200 len: 1304 microversion: 2.1 time: 0.094122 Aug 27 01:38:56.774469 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 580/1219] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:38:56 2021] GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:38:57.790650 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d461f28f-f033-49b1-bd48-47ba8e562e40 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:38:57.791242 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d461f28f-f033-49b1-bd48-47ba8e562e40 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] [instance: 7ea59999-142b-4eda-81ac-a1d6b5cd40d6] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:38:57.797165 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d461f28f-f033-49b1-bd48-47ba8e562e40 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:57.797610 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d461f28f-f033-49b1-bd48-47ba8e562e40 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:57.798618 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d461f28f-f033-49b1-bd48-47ba8e562e40 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:38:57.799050 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d461f28f-f033-49b1-bd48-47ba8e562e40 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:38:57.812937 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.wsgi [None req-d461f28f-f033-49b1-bd48-47ba8e562e40 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] HTTP exception thrown: Instance 7ea59999-142b-4eda-81ac-a1d6b5cd40d6 could not be found. Aug 27 01:38:57.813541 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d461f28f-f033-49b1-bd48-47ba8e562e40 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] Returning 404 to user: Instance 7ea59999-142b-4eda-81ac-a1d6b5cd40d6 could not be found. {{(pid=108755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:38:57.814358 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d461f28f-f033-49b1-bd48-47ba8e562e40 tempest-VolumesNegativeTest-1799365402 tempest-VolumesNegativeTest-1799365402-project] 10.222.0.25 "GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6" status: 404 len: 111 microversion: 2.1 time: 0.027431 Aug 27 01:38:57.814883 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 640/1220] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:38:57 2021] GET /compute/v2.1/servers/7ea59999-142b-4eda-81ac-a1d6b5cd40d6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 01:39:00.504782 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-0379f27e-a563-41ef-94f0-fe7dd7590499 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1508737770", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1454714052", "security_groups": [{"name": "tempest-secgroup-smoke-2128433478"}], "networks": [{"uuid": "4dd6da0d-1759-4b21-a814-ac1356beb0a9"}], "block_device_mapping_v2": [{"uuid": "8e8fad53-734c-43e3-a941-ce1db319b07f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:39:00.620135 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.network.neutron [None req-0379f27e-a563-41ef-94f0-fe7dd7590499 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] validate_networks() for [('4dd6da0d-1759-4b21-a814-ac1356beb0a9', None, None, None, None, None)] {{(pid=108756) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 01:39:00.993294 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-0379f27e-a563-41ef-94f0-fe7dd7590499 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Flavor limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 01:39:00.993856 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-0379f27e-a563-41ef-94f0-fe7dd7590499 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Image limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 01:39:00.994410 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-0379f27e-a563-41ef-94f0-fe7dd7590499 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Flavor pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 01:39:00.994817 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-0379f27e-a563-41ef-94f0-fe7dd7590499 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Image pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 01:39:00.995219 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-0379f27e-a563-41ef-94f0-fe7dd7590499 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 01:39:01.007802 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0379f27e-a563-41ef-94f0-fe7dd7590499 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:01.008352 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0379f27e-a563-41ef-94f0-fe7dd7590499 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:01.009053 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0379f27e-a563-41ef-94f0-fe7dd7590499 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:01.009480 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0379f27e-a563-41ef-94f0-fe7dd7590499 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:01.026764 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-0379f27e-a563-41ef-94f0-fe7dd7590499 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Getting quotas for project d683ea4300b545fda6f56b5c11ee189c. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:39:01.030659 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-0379f27e-a563-41ef-94f0-fe7dd7590499 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Getting quotas for user ded8a106d4d64603a7c87306eae430b7 and project d683ea4300b545fda6f56b5c11ee189c. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:39:01.096558 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-0379f27e-a563-41ef-94f0-fe7dd7590499 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Going to run 1 instances... {{(pid=108756) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 01:39:01.100168 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-0379f27e-a563-41ef-94f0-fe7dd7590499 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8e8fad53-734c-43e3-a941-ce1db319b07f',volume_size=None,volume_type=None)] {{(pid=108756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 01:39:01.478153 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-0379f27e-a563-41ef-94f0-fe7dd7590499 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.977281 Aug 27 01:39:01.478803 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 581/1221] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Aug 27 01:39:00 2021] POST /compute/v2.1/servers => generated 406 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 01:39:01.489654 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-cd1bf06d-ba7f-415e-a828-46b5e1d3f1bc tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:01.490259 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-cd1bf06d-ba7f-415e-a828-46b5e1d3f1bc tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:01.542053 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-cd1bf06d-ba7f-415e-a828-46b5e1d3f1bc tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:01.549826 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-cd1bf06d-ba7f-415e-a828-46b5e1d3f1bc tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1089 microversion: 2.1 time: 0.065033 Aug 27 01:39:01.550521 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 641/1222] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:01 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1089 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:39:02.565896 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c8fceb4b-d1b7-482a-b022-55d7e120b5ad tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:02.567111 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c8fceb4b-d1b7-482a-b022-55d7e120b5ad tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:02.573201 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c8fceb4b-d1b7-482a-b022-55d7e120b5ad tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:02.573652 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c8fceb4b-d1b7-482a-b022-55d7e120b5ad tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:02.574415 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c8fceb4b-d1b7-482a-b022-55d7e120b5ad tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:02.574850 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c8fceb4b-d1b7-482a-b022-55d7e120b5ad tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:02.639966 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c8fceb4b-d1b7-482a-b022-55d7e120b5ad tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:02.648430 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c8fceb4b-d1b7-482a-b022-55d7e120b5ad tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1139 microversion: 2.1 time: 0.086176 Aug 27 01:39:02.649393 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 582/1223] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:02 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1139 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:39:03.665003 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-035e2d9a-d1a0-4b84-b004-c2854bc87259 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:03.665614 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-035e2d9a-d1a0-4b84-b004-c2854bc87259 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:03.671307 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-035e2d9a-d1a0-4b84-b004-c2854bc87259 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:03.671747 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-035e2d9a-d1a0-4b84-b004-c2854bc87259 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:03.673799 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-035e2d9a-d1a0-4b84-b004-c2854bc87259 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:03.673799 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-035e2d9a-d1a0-4b84-b004-c2854bc87259 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:03.743768 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-035e2d9a-d1a0-4b84-b004-c2854bc87259 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:03.751296 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-035e2d9a-d1a0-4b84-b004-c2854bc87259 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1195 microversion: 2.1 time: 0.089880 Aug 27 01:39:03.751851 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 642/1224] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:03 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1195 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:39:04.774690 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-b33738a5-0ae0-4f96-a34a-f6b3364f93ff tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:04.776578 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-b33738a5-0ae0-4f96-a34a-f6b3364f93ff tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:04.786079 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b33738a5-0ae0-4f96-a34a-f6b3364f93ff tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:04.786769 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b33738a5-0ae0-4f96-a34a-f6b3364f93ff tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:04.787745 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b33738a5-0ae0-4f96-a34a-f6b3364f93ff tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:04.788493 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b33738a5-0ae0-4f96-a34a-f6b3364f93ff tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:04.926381 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-b33738a5-0ae0-4f96-a34a-f6b3364f93ff tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:04.933325 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-b33738a5-0ae0-4f96-a34a-f6b3364f93ff tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1273 microversion: 2.1 time: 0.168007 Aug 27 01:39:04.933896 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 583/1225] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:04 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1273 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:39:05.471943 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-d659b14d-3143-4ea0-8564-316397cd3014 req-25838ea6-e746-43e3-971f-9a6373a4fcb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b043518-6eef-4325-8de3-ed41b0cafbd3", "tag": "66ae3a5c-bed1-480a-8aa0-cda45f03b919"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:39:05.474406 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:39:05.474406 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:39:05.484404 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-d659b14d-3143-4ea0-8564-316397cd3014 req-25838ea6-e746-43e3-971f-9a6373a4fcb9 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:05.484935 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-d659b14d-3143-4ea0-8564-316397cd3014 req-25838ea6-e746-43e3-971f-9a6373a4fcb9 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:05.500552 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-d659b14d-3143-4ea0-8564-316397cd3014 req-25838ea6-e746-43e3-971f-9a6373a4fcb9 service nova] Creating event network-changed:66ae3a5c-bed1-480a-8aa0-cda45f03b919 for instance 9b043518-6eef-4325-8de3-ed41b0cafbd3 on hv-cinder-75916 Aug 27 01:39:05.507393 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-d659b14d-3143-4ea0-8564-316397cd3014 req-25838ea6-e746-43e3-971f-9a6373a4fcb9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039885 Aug 27 01:39:05.508273 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 643/1226] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:39:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:39:05.951467 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-7050253a-b62a-4714-b829-6fbc0ed88561 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:05.952082 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-7050253a-b62a-4714-b829-6fbc0ed88561 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:05.958596 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7050253a-b62a-4714-b829-6fbc0ed88561 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:05.959052 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7050253a-b62a-4714-b829-6fbc0ed88561 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:05.959965 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7050253a-b62a-4714-b829-6fbc0ed88561 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:05.960389 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-7050253a-b62a-4714-b829-6fbc0ed88561 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:06.095753 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-7050253a-b62a-4714-b829-6fbc0ed88561 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:06.103986 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-7050253a-b62a-4714-b829-6fbc0ed88561 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1261 microversion: 2.1 time: 0.156233 Aug 27 01:39:06.113052 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 584/1227] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:05 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:39:07.121204 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-c05a199c-994e-4cb4-bb3c-e6ca48a4fa45 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:07.121809 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-c05a199c-994e-4cb4-bb3c-e6ca48a4fa45 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:07.127788 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c05a199c-994e-4cb4-bb3c-e6ca48a4fa45 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:07.128227 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c05a199c-994e-4cb4-bb3c-e6ca48a4fa45 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:07.129696 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c05a199c-994e-4cb4-bb3c-e6ca48a4fa45 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:07.130131 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c05a199c-994e-4cb4-bb3c-e6ca48a4fa45 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:07.248651 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-c05a199c-994e-4cb4-bb3c-e6ca48a4fa45 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:07.256464 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-c05a199c-994e-4cb4-bb3c-e6ca48a4fa45 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1261 microversion: 2.1 time: 0.139406 Aug 27 01:39:07.257047 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 644/1228] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:07 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1261 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:39:08.273016 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-92932b48-b89e-4d0f-937a-e89d7e6acf0d tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:08.273550 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-92932b48-b89e-4d0f-937a-e89d7e6acf0d tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:08.279350 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-92932b48-b89e-4d0f-937a-e89d7e6acf0d tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:08.279803 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-92932b48-b89e-4d0f-937a-e89d7e6acf0d tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:08.280595 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-92932b48-b89e-4d0f-937a-e89d7e6acf0d tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:08.281063 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-92932b48-b89e-4d0f-937a-e89d7e6acf0d tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:08.405501 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-92932b48-b89e-4d0f-937a-e89d7e6acf0d tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:08.414521 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-92932b48-b89e-4d0f-937a-e89d7e6acf0d tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1261 microversion: 2.1 time: 0.145713 Aug 27 01:39:08.415096 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 585/1229] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:08 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1261 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:39:09.432178 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-c64bfe85-8ece-4392-a178-1b98763a5034 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:09.432826 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-c64bfe85-8ece-4392-a178-1b98763a5034 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:09.438529 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c64bfe85-8ece-4392-a178-1b98763a5034 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:09.438974 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c64bfe85-8ece-4392-a178-1b98763a5034 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:09.439736 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c64bfe85-8ece-4392-a178-1b98763a5034 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:09.440170 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c64bfe85-8ece-4392-a178-1b98763a5034 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:09.560072 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-c64bfe85-8ece-4392-a178-1b98763a5034 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:09.570620 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-c64bfe85-8ece-4392-a178-1b98763a5034 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1261 microversion: 2.1 time: 0.142242 Aug 27 01:39:09.571184 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 645/1230] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:09 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1261 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:39:10.587716 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-81ea55ca-4bdf-4a5d-bf20-6769fef21a6b tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:10.588307 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-81ea55ca-4bdf-4a5d-bf20-6769fef21a6b tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:10.594140 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-81ea55ca-4bdf-4a5d-bf20-6769fef21a6b tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:10.598863 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-81ea55ca-4bdf-4a5d-bf20-6769fef21a6b tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:10.598863 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-81ea55ca-4bdf-4a5d-bf20-6769fef21a6b tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:10.598863 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-81ea55ca-4bdf-4a5d-bf20-6769fef21a6b tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:10.789354 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-81ea55ca-4bdf-4a5d-bf20-6769fef21a6b tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:10.796602 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-81ea55ca-4bdf-4a5d-bf20-6769fef21a6b tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1261 microversion: 2.1 time: 0.212627 Aug 27 01:39:10.797216 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 586/1231] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:10 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1261 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:39:11.813279 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-39dddd89-3335-414c-97f0-0693d9abd87e tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:11.814217 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-39dddd89-3335-414c-97f0-0693d9abd87e tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:11.820101 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-39dddd89-3335-414c-97f0-0693d9abd87e tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:11.820634 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-39dddd89-3335-414c-97f0-0693d9abd87e tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:11.821519 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-39dddd89-3335-414c-97f0-0693d9abd87e tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:11.822014 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-39dddd89-3335-414c-97f0-0693d9abd87e tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:11.950480 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-39dddd89-3335-414c-97f0-0693d9abd87e tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:11.959645 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-39dddd89-3335-414c-97f0-0693d9abd87e tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1261 microversion: 2.1 time: 0.150027 Aug 27 01:39:11.967219 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 646/1232] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:11 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:39:12.976368 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b9a2838d-0571-43fc-b3f1-3ac37eecd7c4] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 01:39:12.980657 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-9e5eba12-f42c-471c-8cda-962279c64254 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:12.981911 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-9e5eba12-f42c-471c-8cda-962279c64254 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:12.988447 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9e5eba12-f42c-471c-8cda-962279c64254 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:12.989903 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9e5eba12-f42c-471c-8cda-962279c64254 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:12.991566 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9e5eba12-f42c-471c-8cda-962279c64254 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:12.992214 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9e5eba12-f42c-471c-8cda-962279c64254 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:13.207852 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-9e5eba12-f42c-471c-8cda-962279c64254 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:13.218330 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-9e5eba12-f42c-471c-8cda-962279c64254 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1261 microversion: 2.1 time: 0.243280 Aug 27 01:39:13.218953 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 587/1233] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:12 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1261 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:39:14.235188 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-eac72410-b479-4722-8d6e-4bb8cc54ff0c tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:14.236549 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-eac72410-b479-4722-8d6e-4bb8cc54ff0c tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:14.243983 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-eac72410-b479-4722-8d6e-4bb8cc54ff0c tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:14.244617 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-eac72410-b479-4722-8d6e-4bb8cc54ff0c tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:14.245622 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-eac72410-b479-4722-8d6e-4bb8cc54ff0c tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:14.246405 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-eac72410-b479-4722-8d6e-4bb8cc54ff0c tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:14.319284 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49bacde0-f4f7-4401-ad1e-0e21fe9180e8] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 01:39:14.378699 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-eac72410-b479-4722-8d6e-4bb8cc54ff0c tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:14.387209 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-eac72410-b479-4722-8d6e-4bb8cc54ff0c tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1261 microversion: 2.1 time: 0.155689 Aug 27 01:39:14.388020 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 647/1234] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:14 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:39:15.407477 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-d4ca5d64-cf12-4b9d-b1cf-d00ea23102cd tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:15.408085 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-d4ca5d64-cf12-4b9d-b1cf-d00ea23102cd tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:15.468333 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d4ca5d64-cf12-4b9d-b1cf-d00ea23102cd tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:15.469017 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d4ca5d64-cf12-4b9d-b1cf-d00ea23102cd tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:15.470008 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d4ca5d64-cf12-4b9d-b1cf-d00ea23102cd tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:15.470674 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d4ca5d64-cf12-4b9d-b1cf-d00ea23102cd tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:15.497871 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO oslo.messaging._drivers.impl_rabbit [-] [b9a2838d-0571-43fc-b3f1-3ac37eecd7c4] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 60776. Aug 27 01:39:15.705204 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-d4ca5d64-cf12-4b9d-b1cf-d00ea23102cd tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:15.713808 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-d4ca5d64-cf12-4b9d-b1cf-d00ea23102cd tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1261 microversion: 2.1 time: 0.312184 Aug 27 01:39:15.715673 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 588/1235] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:15 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1261 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:39:16.740519 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-912215f2-3a57-46bd-85e0-105c8561672f tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:16.740519 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-912215f2-3a57-46bd-85e0-105c8561672f tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:16.750199 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-912215f2-3a57-46bd-85e0-105c8561672f tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:16.750656 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-912215f2-3a57-46bd-85e0-105c8561672f tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:16.751438 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-912215f2-3a57-46bd-85e0-105c8561672f tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:16.751881 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-912215f2-3a57-46bd-85e0-105c8561672f tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:16.758924 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO oslo.messaging._drivers.impl_rabbit [-] [49bacde0-f4f7-4401-ad1e-0e21fe9180e8] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 60796. Aug 27 01:39:16.893789 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-912215f2-3a57-46bd-85e0-105c8561672f tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:16.903843 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-912215f2-3a57-46bd-85e0-105c8561672f tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1261 microversion: 2.1 time: 0.174546 Aug 27 01:39:16.904772 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 648/1236] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:16 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1261 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:39:17.055082 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-e91c4549-f589-4d0a-bd9a-8804d1df003a req-84185824-c6ec-4782-9f17-85adb291bf06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b043518-6eef-4325-8de3-ed41b0cafbd3", "name": "network-vif-plugged", "status": "completed", "tag": "66ae3a5c-bed1-480a-8aa0-cda45f03b919"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:39:17.056719 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:39:17.056719 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:39:17.063591 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-e91c4549-f589-4d0a-bd9a-8804d1df003a req-84185824-c6ec-4782-9f17-85adb291bf06 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:17.064037 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-e91c4549-f589-4d0a-bd9a-8804d1df003a req-84185824-c6ec-4782-9f17-85adb291bf06 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:17.075999 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-e91c4549-f589-4d0a-bd9a-8804d1df003a req-84185824-c6ec-4782-9f17-85adb291bf06 service nova] Creating event network-vif-plugged:66ae3a5c-bed1-480a-8aa0-cda45f03b919 for instance 9b043518-6eef-4325-8de3-ed41b0cafbd3 on hv-cinder-75916 Aug 27 01:39:17.085441 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-e91c4549-f589-4d0a-bd9a-8804d1df003a req-84185824-c6ec-4782-9f17-85adb291bf06 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033185 Aug 27 01:39:17.085441 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 589/1237] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:39:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:39:17.926034 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-e0afb136-fbd0-4ad9-8cb5-152a60893833 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:17.926730 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-e0afb136-fbd0-4ad9-8cb5-152a60893833 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:17.935739 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e0afb136-fbd0-4ad9-8cb5-152a60893833 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:17.936191 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e0afb136-fbd0-4ad9-8cb5-152a60893833 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:17.937022 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e0afb136-fbd0-4ad9-8cb5-152a60893833 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:17.937468 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e0afb136-fbd0-4ad9-8cb5-152a60893833 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:18.132380 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-e0afb136-fbd0-4ad9-8cb5-152a60893833 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:18.141793 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-e0afb136-fbd0-4ad9-8cb5-152a60893833 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1261 microversion: 2.1 time: 0.220552 Aug 27 01:39:18.152793 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 649/1238] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:17 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1261 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:39:19.160500 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-f89981d7-be26-4598-a695-d6569b55f4fe tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:19.161314 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-f89981d7-be26-4598-a695-d6569b55f4fe tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:19.167933 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f89981d7-be26-4598-a695-d6569b55f4fe tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:19.168477 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f89981d7-be26-4598-a695-d6569b55f4fe tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:19.169391 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f89981d7-be26-4598-a695-d6569b55f4fe tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:19.169918 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f89981d7-be26-4598-a695-d6569b55f4fe tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:19.313042 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-f89981d7-be26-4598-a695-d6569b55f4fe tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:19.324122 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-f89981d7-be26-4598-a695-d6569b55f4fe tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1446 microversion: 2.1 time: 0.168551 Aug 27 01:39:19.324998 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 590/1239] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:19 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1446 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:39:19.343248 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-d9aec7f2-e004-4666-8546-13d7a8dceeb6 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:19.343880 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-d9aec7f2-e004-4666-8546-13d7a8dceeb6 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:19.355727 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d9aec7f2-e004-4666-8546-13d7a8dceeb6 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:19.355727 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d9aec7f2-e004-4666-8546-13d7a8dceeb6 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:19.355727 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d9aec7f2-e004-4666-8546-13d7a8dceeb6 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:19.355727 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-d9aec7f2-e004-4666-8546-13d7a8dceeb6 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:19.688442 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-d9aec7f2-e004-4666-8546-13d7a8dceeb6 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:19.697235 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-d9aec7f2-e004-4666-8546-13d7a8dceeb6 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1446 microversion: 2.1 time: 0.360030 Aug 27 01:39:19.707951 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 650/1240] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:19 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1446 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:39:22.064304 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-9e87e12d-6bcd-4d41-b95e-4de9bc4a9421 req-6d8065cf-a56e-487b-a535-fc61ca2feb79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b043518-6eef-4325-8de3-ed41b0cafbd3", "tag": "66ae3a5c-bed1-480a-8aa0-cda45f03b919"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:39:22.066550 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:39:22.066550 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:39:22.074492 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-9e87e12d-6bcd-4d41-b95e-4de9bc4a9421 req-6d8065cf-a56e-487b-a535-fc61ca2feb79 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:22.075125 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-9e87e12d-6bcd-4d41-b95e-4de9bc4a9421 req-6d8065cf-a56e-487b-a535-fc61ca2feb79 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:22.089314 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-9e87e12d-6bcd-4d41-b95e-4de9bc4a9421 req-6d8065cf-a56e-487b-a535-fc61ca2feb79 service nova] Creating event network-changed:66ae3a5c-bed1-480a-8aa0-cda45f03b919 for instance 9b043518-6eef-4325-8de3-ed41b0cafbd3 on hv-cinder-75916 Aug 27 01:39:22.095437 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-9e87e12d-6bcd-4d41-b95e-4de9bc4a9421 req-6d8065cf-a56e-487b-a535-fc61ca2feb79 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035227 Aug 27 01:39:22.101109 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 591/1241] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:39:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:39:23.031707 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-411d5656-7d4f-4abf-9c2b-ebc3221f94a2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Action: 'create', calling method: .version_select at 0x7ff2141bdee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1188750384"}} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:39:23.052543 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-411d5656-7d4f-4abf-9c2b-ebc3221f94a2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Getting quotas for project e450a8d39c6c4bc1aa95f2240bf96927. Resources: {'key_pairs'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:39:23.056677 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-411d5656-7d4f-4abf-9c2b-ebc3221f94a2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Getting quotas for user a6b922afb576470db214cfe37258a289 and project e450a8d39c6c4bc1aa95f2240bf96927. Resources: {'key_pairs'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:39:23.407262 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-411d5656-7d4f-4abf-9c2b-ebc3221f94a2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Getting quotas for project e450a8d39c6c4bc1aa95f2240bf96927. Resources: {'key_pairs'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:39:23.412861 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.quota [None req-411d5656-7d4f-4abf-9c2b-ebc3221f94a2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Getting quotas for user a6b922afb576470db214cfe37258a289 and project e450a8d39c6c4bc1aa95f2240bf96927. Resources: {'key_pairs'} {{(pid=108755) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:39:23.432641 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-411d5656-7d4f-4abf-9c2b-ebc3221f94a2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.642374 Aug 27 01:39:23.438220 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 651/1242] 10.222.0.25 () {60 vars in 1158 bytes} [Fri Aug 27 01:39:22 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:39:44.733848 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-9f13320a-7665-4ad4-b2ff-7e6ddc222c53 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-701908236", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1188750384", "security_groups": [{"name": "tempest-secgroup-smoke-1562836854"}], "block_device_mapping_v2": [{"uuid": "0db8cdad-179f-4cbd-8d33-0acc8fe9a6f5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "36f8a83c-fcee-45f1-9a2d-3d2de8a9383c"}]}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:39:44.834536 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.network.neutron [None req-9f13320a-7665-4ad4-b2ff-7e6ddc222c53 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] validate_networks() for [('36f8a83c-fcee-45f1-9a2d-3d2de8a9383c', None, None, None, None, None)] {{(pid=108756) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 01:39:45.182900 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-9f13320a-7665-4ad4-b2ff-7e6ddc222c53 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Flavor limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 01:39:45.183355 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-9f13320a-7665-4ad4-b2ff-7e6ddc222c53 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Image limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 01:39:45.183832 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-9f13320a-7665-4ad4-b2ff-7e6ddc222c53 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Flavor pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 01:39:45.184222 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-9f13320a-7665-4ad4-b2ff-7e6ddc222c53 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Image pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 01:39:45.184627 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-9f13320a-7665-4ad4-b2ff-7e6ddc222c53 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 01:39:45.193289 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9f13320a-7665-4ad4-b2ff-7e6ddc222c53 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:45.193678 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9f13320a-7665-4ad4-b2ff-7e6ddc222c53 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:45.194474 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9f13320a-7665-4ad4-b2ff-7e6ddc222c53 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:45.194904 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9f13320a-7665-4ad4-b2ff-7e6ddc222c53 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:45.211887 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-9f13320a-7665-4ad4-b2ff-7e6ddc222c53 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Getting quotas for project e450a8d39c6c4bc1aa95f2240bf96927. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:39:45.216175 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-9f13320a-7665-4ad4-b2ff-7e6ddc222c53 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Getting quotas for user a6b922afb576470db214cfe37258a289 and project e450a8d39c6c4bc1aa95f2240bf96927. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:39:45.279790 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-9f13320a-7665-4ad4-b2ff-7e6ddc222c53 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Going to run 1 instances... {{(pid=108756) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 01:39:45.282208 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-9f13320a-7665-4ad4-b2ff-7e6ddc222c53 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: b1462288-b9a8-48fe-9593-e9572fd0b7ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0db8cdad-179f-4cbd-8d33-0acc8fe9a6f5',volume_size=None,volume_type=None)] {{(pid=108756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 01:39:45.768456 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-9f13320a-7665-4ad4-b2ff-7e6ddc222c53 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.038512 Aug 27 01:39:45.769236 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 592/1243] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Aug 27 01:39:44 2021] POST /compute/v2.1/servers => generated 406 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 01:39:45.778775 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-8e6b306f-d1df-481f-bdc0-c3f24f1a6c86 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:45.779797 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-8e6b306f-d1df-481f-bdc0-c3f24f1a6c86 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: b1462288-b9a8-48fe-9593-e9572fd0b7ba] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:45.832000 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-8e6b306f-d1df-481f-bdc0-c3f24f1a6c86 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:45.838395 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-8e6b306f-d1df-481f-bdc0-c3f24f1a6c86 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba" status: 200 len: 1094 microversion: 2.1 time: 0.063308 Aug 27 01:39:45.838909 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 652/1244] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:45 2021] GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba => generated 1094 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:39:46.854920 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c31ca585-d595-40bf-90ef-e595b7e91d6c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:46.855526 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c31ca585-d595-40bf-90ef-e595b7e91d6c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: b1462288-b9a8-48fe-9593-e9572fd0b7ba] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:46.861866 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c31ca585-d595-40bf-90ef-e595b7e91d6c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:46.862499 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c31ca585-d595-40bf-90ef-e595b7e91d6c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:46.863289 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c31ca585-d595-40bf-90ef-e595b7e91d6c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:46.863715 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c31ca585-d595-40bf-90ef-e595b7e91d6c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:46.924108 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c31ca585-d595-40bf-90ef-e595b7e91d6c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:46.932082 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c31ca585-d595-40bf-90ef-e595b7e91d6c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba" status: 200 len: 1136 microversion: 2.1 time: 0.080804 Aug 27 01:39:46.932643 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 593/1245] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:46 2021] GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba => generated 1136 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:39:47.949141 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-12f6f4d0-12dd-491d-96f4-6e2fc7e2be8e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:47.949762 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-12f6f4d0-12dd-491d-96f4-6e2fc7e2be8e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: b1462288-b9a8-48fe-9593-e9572fd0b7ba] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:47.957419 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-12f6f4d0-12dd-491d-96f4-6e2fc7e2be8e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:47.957876 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-12f6f4d0-12dd-491d-96f4-6e2fc7e2be8e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:47.958685 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-12f6f4d0-12dd-491d-96f4-6e2fc7e2be8e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:47.959387 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-12f6f4d0-12dd-491d-96f4-6e2fc7e2be8e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:48.035413 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-12f6f4d0-12dd-491d-96f4-6e2fc7e2be8e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:48.042491 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-12f6f4d0-12dd-491d-96f4-6e2fc7e2be8e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba" status: 200 len: 1210 microversion: 2.1 time: 0.096941 Aug 27 01:39:48.043056 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 653/1246] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:47 2021] GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba => generated 1210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:39:49.059528 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ee5d38ec-7b9c-4359-b176-fdf87c5ac698 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:49.060669 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-ee5d38ec-7b9c-4359-b176-fdf87c5ac698 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: b1462288-b9a8-48fe-9593-e9572fd0b7ba] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:49.068004 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ee5d38ec-7b9c-4359-b176-fdf87c5ac698 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:49.068608 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ee5d38ec-7b9c-4359-b176-fdf87c5ac698 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:49.069518 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ee5d38ec-7b9c-4359-b176-fdf87c5ac698 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:49.069952 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ee5d38ec-7b9c-4359-b176-fdf87c5ac698 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:49.213371 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ee5d38ec-7b9c-4359-b176-fdf87c5ac698 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:49.220703 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-ee5d38ec-7b9c-4359-b176-fdf87c5ac698 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba" status: 200 len: 1278 microversion: 2.1 time: 0.165049 Aug 27 01:39:49.221298 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 594/1247] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:49 2021] GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:39:49.321331 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-bcb44ab7-28d4-4da7-abf1-cff9aca556c5 req-4ab9bd60-0652-4e6e-aa5e-b669f0d9d882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1462288-b9a8-48fe-9593-e9572fd0b7ba", "tag": "dac3e0d4-350a-4e21-a74f-eeb422da3bd7"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:39:49.322858 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:39:49.322858 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:39:49.330448 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-bcb44ab7-28d4-4da7-abf1-cff9aca556c5 req-4ab9bd60-0652-4e6e-aa5e-b669f0d9d882 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:49.331850 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-bcb44ab7-28d4-4da7-abf1-cff9aca556c5 req-4ab9bd60-0652-4e6e-aa5e-b669f0d9d882 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:49.349745 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-bcb44ab7-28d4-4da7-abf1-cff9aca556c5 req-4ab9bd60-0652-4e6e-aa5e-b669f0d9d882 service nova] Creating event network-changed:dac3e0d4-350a-4e21-a74f-eeb422da3bd7 for instance b1462288-b9a8-48fe-9593-e9572fd0b7ba on hv-cinder-75916 Aug 27 01:39:49.355563 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-bcb44ab7-28d4-4da7-abf1-cff9aca556c5 req-4ab9bd60-0652-4e6e-aa5e-b669f0d9d882 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037923 Aug 27 01:39:49.356528 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 654/1248] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:39:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:39:50.253792 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-55e9334d-aee4-401e-9155-740f177c4806 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:50.254328 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-55e9334d-aee4-401e-9155-740f177c4806 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: b1462288-b9a8-48fe-9593-e9572fd0b7ba] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:50.260161 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-55e9334d-aee4-401e-9155-740f177c4806 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:50.260607 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-55e9334d-aee4-401e-9155-740f177c4806 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:50.267034 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-55e9334d-aee4-401e-9155-740f177c4806 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:50.267034 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-55e9334d-aee4-401e-9155-740f177c4806 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:50.381928 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-55e9334d-aee4-401e-9155-740f177c4806 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:50.388981 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-55e9334d-aee4-401e-9155-740f177c4806 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba" status: 200 len: 1266 microversion: 2.1 time: 0.139009 Aug 27 01:39:50.389546 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 595/1249] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:50 2021] GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:39:51.406852 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-35a315a2-e664-4766-8aa6-81445c412145 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:51.407536 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-35a315a2-e664-4766-8aa6-81445c412145 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: b1462288-b9a8-48fe-9593-e9572fd0b7ba] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:51.413995 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-35a315a2-e664-4766-8aa6-81445c412145 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:51.414430 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-35a315a2-e664-4766-8aa6-81445c412145 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:51.415190 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-35a315a2-e664-4766-8aa6-81445c412145 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:51.415615 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-35a315a2-e664-4766-8aa6-81445c412145 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:51.538069 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-35a315a2-e664-4766-8aa6-81445c412145 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:51.545317 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-35a315a2-e664-4766-8aa6-81445c412145 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba" status: 200 len: 1266 microversion: 2.1 time: 0.142539 Aug 27 01:39:51.545871 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 655/1250] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:51 2021] GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:39:52.562373 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-9b882ff3-7155-48fb-a663-961abc911776 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:52.562980 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-9b882ff3-7155-48fb-a663-961abc911776 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: b1462288-b9a8-48fe-9593-e9572fd0b7ba] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:52.568847 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9b882ff3-7155-48fb-a663-961abc911776 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:52.572407 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9b882ff3-7155-48fb-a663-961abc911776 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:52.572407 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9b882ff3-7155-48fb-a663-961abc911776 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:52.572407 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9b882ff3-7155-48fb-a663-961abc911776 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:52.689266 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-9b882ff3-7155-48fb-a663-961abc911776 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:52.696678 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-9b882ff3-7155-48fb-a663-961abc911776 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba" status: 200 len: 1266 microversion: 2.1 time: 0.137928 Aug 27 01:39:52.697261 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 596/1251] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:52 2021] GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:39:53.713504 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-6eaea325-731d-4577-97be-19fd4059816d tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:53.714010 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-6eaea325-731d-4577-97be-19fd4059816d tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: b1462288-b9a8-48fe-9593-e9572fd0b7ba] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:53.719858 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6eaea325-731d-4577-97be-19fd4059816d tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:53.720307 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6eaea325-731d-4577-97be-19fd4059816d tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:53.721589 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6eaea325-731d-4577-97be-19fd4059816d tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:53.722024 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-6eaea325-731d-4577-97be-19fd4059816d tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:53.842173 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-6eaea325-731d-4577-97be-19fd4059816d tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:53.849748 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-6eaea325-731d-4577-97be-19fd4059816d tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba" status: 200 len: 1266 microversion: 2.1 time: 0.139988 Aug 27 01:39:53.850307 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 656/1252] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:53 2021] GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:39:54.865443 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-0b3117ac-ddf8-4763-930b-2055e9d39975 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:54.866046 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-0b3117ac-ddf8-4763-930b-2055e9d39975 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: b1462288-b9a8-48fe-9593-e9572fd0b7ba] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:54.871996 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0b3117ac-ddf8-4763-930b-2055e9d39975 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:54.872437 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0b3117ac-ddf8-4763-930b-2055e9d39975 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:54.873214 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0b3117ac-ddf8-4763-930b-2055e9d39975 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:54.873644 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0b3117ac-ddf8-4763-930b-2055e9d39975 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:54.992576 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-0b3117ac-ddf8-4763-930b-2055e9d39975 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:54.999809 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-0b3117ac-ddf8-4763-930b-2055e9d39975 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba" status: 200 len: 1266 microversion: 2.1 time: 0.138057 Aug 27 01:39:55.000375 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 597/1253] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:54 2021] GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:39:56.016050 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-50b22519-6633-448a-8664-02060f8e5dd7 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:56.016661 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-50b22519-6633-448a-8664-02060f8e5dd7 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: b1462288-b9a8-48fe-9593-e9572fd0b7ba] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:56.022512 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-50b22519-6633-448a-8664-02060f8e5dd7 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:56.022959 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-50b22519-6633-448a-8664-02060f8e5dd7 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:56.023716 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-50b22519-6633-448a-8664-02060f8e5dd7 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:56.024148 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-50b22519-6633-448a-8664-02060f8e5dd7 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:56.140755 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-50b22519-6633-448a-8664-02060f8e5dd7 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:56.147926 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-50b22519-6633-448a-8664-02060f8e5dd7 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba" status: 200 len: 1266 microversion: 2.1 time: 0.135519 Aug 27 01:39:56.148477 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 657/1254] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:56 2021] GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:39:57.164189 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ff724695-1380-4c0d-b138-4a760f4d7e85 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:57.164789 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-ff724695-1380-4c0d-b138-4a760f4d7e85 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: b1462288-b9a8-48fe-9593-e9572fd0b7ba] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:57.170639 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ff724695-1380-4c0d-b138-4a760f4d7e85 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:57.171079 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ff724695-1380-4c0d-b138-4a760f4d7e85 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:57.172098 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ff724695-1380-4c0d-b138-4a760f4d7e85 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:57.172529 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ff724695-1380-4c0d-b138-4a760f4d7e85 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:57.290562 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ff724695-1380-4c0d-b138-4a760f4d7e85 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:57.298051 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-ff724695-1380-4c0d-b138-4a760f4d7e85 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba" status: 200 len: 1266 microversion: 2.1 time: 0.137591 Aug 27 01:39:57.298589 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 598/1255] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:57 2021] GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:39:58.315656 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-071bb50a-9a56-41d2-8020-ae831f3c7dc6 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:58.316258 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-071bb50a-9a56-41d2-8020-ae831f3c7dc6 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: b1462288-b9a8-48fe-9593-e9572fd0b7ba] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:58.322221 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-071bb50a-9a56-41d2-8020-ae831f3c7dc6 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:58.322662 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-071bb50a-9a56-41d2-8020-ae831f3c7dc6 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:58.323420 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-071bb50a-9a56-41d2-8020-ae831f3c7dc6 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:58.323885 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-071bb50a-9a56-41d2-8020-ae831f3c7dc6 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:58.445214 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-071bb50a-9a56-41d2-8020-ae831f3c7dc6 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:58.452327 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-071bb50a-9a56-41d2-8020-ae831f3c7dc6 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba" status: 200 len: 1266 microversion: 2.1 time: 0.140946 Aug 27 01:39:58.452904 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 658/1256] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:58 2021] GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:39:59.203667 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-e2e6fc85-3aa6-4e0a-9b26-44a2e3050110 req-473232b5-2911-4c94-b270-14a1d363a8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1462288-b9a8-48fe-9593-e9572fd0b7ba", "name": "network-vif-plugged", "status": "completed", "tag": "dac3e0d4-350a-4e21-a74f-eeb422da3bd7"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:39:59.205506 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:39:59.205506 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:39:59.212430 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-e2e6fc85-3aa6-4e0a-9b26-44a2e3050110 req-473232b5-2911-4c94-b270-14a1d363a8e1 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:59.212890 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-e2e6fc85-3aa6-4e0a-9b26-44a2e3050110 req-473232b5-2911-4c94-b270-14a1d363a8e1 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:59.223983 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-e2e6fc85-3aa6-4e0a-9b26-44a2e3050110 req-473232b5-2911-4c94-b270-14a1d363a8e1 service nova] Creating event network-vif-plugged:dac3e0d4-350a-4e21-a74f-eeb422da3bd7 for instance b1462288-b9a8-48fe-9593-e9572fd0b7ba on hv-cinder-75916 Aug 27 01:39:59.229088 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-e2e6fc85-3aa6-4e0a-9b26-44a2e3050110 req-473232b5-2911-4c94-b270-14a1d363a8e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029076 Aug 27 01:39:59.229655 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 599/1257] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:39:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:39:59.469594 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-c09f873b-f903-4ea6-9777-95e8ffebcd0c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:39:59.470129 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-c09f873b-f903-4ea6-9777-95e8ffebcd0c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: b1462288-b9a8-48fe-9593-e9572fd0b7ba] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:39:59.476558 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c09f873b-f903-4ea6-9777-95e8ffebcd0c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:59.477029 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c09f873b-f903-4ea6-9777-95e8ffebcd0c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:59.477911 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c09f873b-f903-4ea6-9777-95e8ffebcd0c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:39:59.478350 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c09f873b-f903-4ea6-9777-95e8ffebcd0c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:39:59.595862 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-c09f873b-f903-4ea6-9777-95e8ffebcd0c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:39:59.603518 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-c09f873b-f903-4ea6-9777-95e8ffebcd0c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba" status: 200 len: 1266 microversion: 2.1 time: 0.137654 Aug 27 01:39:59.609023 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 659/1258] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:39:59 2021] GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:40:00.620701 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-f729b242-a168-4d02-b045-14007c8877d5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:40:00.621445 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-f729b242-a168-4d02-b045-14007c8877d5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: b1462288-b9a8-48fe-9593-e9572fd0b7ba] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:40:00.627563 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f729b242-a168-4d02-b045-14007c8877d5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:40:00.628005 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f729b242-a168-4d02-b045-14007c8877d5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:40:00.628769 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f729b242-a168-4d02-b045-14007c8877d5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:40:00.629224 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f729b242-a168-4d02-b045-14007c8877d5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:40:00.752647 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-f729b242-a168-4d02-b045-14007c8877d5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:40:00.759980 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-f729b242-a168-4d02-b045-14007c8877d5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba" status: 200 len: 1266 microversion: 2.1 time: 0.143393 Aug 27 01:40:00.760539 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 600/1259] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:40:00 2021] GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:40:01.776447 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-cc930809-1cfe-4279-ae1c-b9dbed39085d tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:40:01.777079 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-cc930809-1cfe-4279-ae1c-b9dbed39085d tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: b1462288-b9a8-48fe-9593-e9572fd0b7ba] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:40:01.782872 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-cc930809-1cfe-4279-ae1c-b9dbed39085d tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:40:01.783955 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-cc930809-1cfe-4279-ae1c-b9dbed39085d tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:40:01.784738 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-cc930809-1cfe-4279-ae1c-b9dbed39085d tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:40:01.785198 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-cc930809-1cfe-4279-ae1c-b9dbed39085d tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:40:01.905740 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-cc930809-1cfe-4279-ae1c-b9dbed39085d tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:40:01.913449 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-cc930809-1cfe-4279-ae1c-b9dbed39085d tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba" status: 200 len: 1453 microversion: 2.1 time: 0.140726 Aug 27 01:40:01.914006 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 660/1260] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:40:01 2021] GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba => generated 1453 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:40:01.929583 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-f4f24313-a125-4b2c-9099-fc39bb2c5cb0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:40:01.930191 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-f4f24313-a125-4b2c-9099-fc39bb2c5cb0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: b1462288-b9a8-48fe-9593-e9572fd0b7ba] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:40:01.936125 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f4f24313-a125-4b2c-9099-fc39bb2c5cb0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:40:01.936571 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f4f24313-a125-4b2c-9099-fc39bb2c5cb0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:40:01.937388 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f4f24313-a125-4b2c-9099-fc39bb2c5cb0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:40:01.937856 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-f4f24313-a125-4b2c-9099-fc39bb2c5cb0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:40:02.064378 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-f4f24313-a125-4b2c-9099-fc39bb2c5cb0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:40:02.073032 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-f4f24313-a125-4b2c-9099-fc39bb2c5cb0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba" status: 200 len: 1453 microversion: 2.1 time: 0.147015 Aug 27 01:40:02.073683 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 601/1261] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:40:01 2021] GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:40:04.015391 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-62a57827-a62f-45ad-bb64-a5ab1f1f2b6e req-3e71099a-9ffe-4b7d-94c4-4a85e30eb373 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1462288-b9a8-48fe-9593-e9572fd0b7ba", "tag": "dac3e0d4-350a-4e21-a74f-eeb422da3bd7"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:40:04.017498 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:40:04.017498 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:40:04.029511 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-62a57827-a62f-45ad-bb64-a5ab1f1f2b6e req-3e71099a-9ffe-4b7d-94c4-4a85e30eb373 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:40:04.029511 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-62a57827-a62f-45ad-bb64-a5ab1f1f2b6e req-3e71099a-9ffe-4b7d-94c4-4a85e30eb373 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:40:04.046311 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-62a57827-a62f-45ad-bb64-a5ab1f1f2b6e req-3e71099a-9ffe-4b7d-94c4-4a85e30eb373 service nova] Creating event network-changed:dac3e0d4-350a-4e21-a74f-eeb422da3bd7 for instance b1462288-b9a8-48fe-9593-e9572fd0b7ba on hv-cinder-75916 Aug 27 01:40:04.052488 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-62a57827-a62f-45ad-bb64-a5ab1f1f2b6e req-3e71099a-9ffe-4b7d-94c4-4a85e30eb373 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044091 Aug 27 01:40:04.053356 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 661/1262] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:40:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:40:18.561791 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 01:40:18.562366 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: Fri Aug 27 01:40:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 01:41:19.719755 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-d2b22399-8051-4790-92c0-6449cfdf8d67 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:41:19.720420 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-d2b22399-8051-4790-92c0-6449cfdf8d67 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:19.726136 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d2b22399-8051-4790-92c0-6449cfdf8d67 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:19.726573 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d2b22399-8051-4790-92c0-6449cfdf8d67 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:19.727325 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d2b22399-8051-4790-92c0-6449cfdf8d67 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:19.727751 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d2b22399-8051-4790-92c0-6449cfdf8d67 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:19.750432 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.objects.instance [None req-d2b22399-8051-4790-92c0-6449cfdf8d67 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lazy-loading 'flavor' on Instance uuid 9b043518-6eef-4325-8de3-ed41b0cafbd3 {{(pid=108756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:41:19.988669 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-d2b22399-8051-4790-92c0-6449cfdf8d67 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "POST /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3/action" status: 202 len: 0 microversion: 2.1 time: 0.273499 Aug 27 01:41:19.989440 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 602/1263] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:41:19 2021] POST /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:41:19.999591 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-1d4bfdf1-80aa-44fc-9253-1beb248e079e tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:20.000500 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-1d4bfdf1-80aa-44fc-9253-1beb248e079e tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:20.006419 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1d4bfdf1-80aa-44fc-9253-1beb248e079e tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:20.006867 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1d4bfdf1-80aa-44fc-9253-1beb248e079e tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:20.007624 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1d4bfdf1-80aa-44fc-9253-1beb248e079e tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:20.008053 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1d4bfdf1-80aa-44fc-9253-1beb248e079e tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:20.177187 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-1d4bfdf1-80aa-44fc-9253-1beb248e079e tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:41:20.184518 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-1d4bfdf1-80aa-44fc-9253-1beb248e079e tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1571 microversion: 2.1 time: 0.190714 Aug 27 01:41:20.185448 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 662/1264] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:41:19 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1571 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:41:21.201946 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-a1d88474-f964-49b2-84d3-314607aaf16d tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:21.202641 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-a1d88474-f964-49b2-84d3-314607aaf16d tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:21.208731 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a1d88474-f964-49b2-84d3-314607aaf16d tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:21.209206 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a1d88474-f964-49b2-84d3-314607aaf16d tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:21.209965 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a1d88474-f964-49b2-84d3-314607aaf16d tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:21.210395 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a1d88474-f964-49b2-84d3-314607aaf16d tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:21.383845 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-a1d88474-f964-49b2-84d3-314607aaf16d tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:41:21.391185 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-a1d88474-f964-49b2-84d3-314607aaf16d tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1571 microversion: 2.1 time: 0.193232 Aug 27 01:41:21.391750 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 603/1265] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:41:21 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1571 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:41:22.407641 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-0b685993-e37d-422f-98e3-98379e12daba tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:22.408273 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-0b685993-e37d-422f-98e3-98379e12daba tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:22.414223 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0b685993-e37d-422f-98e3-98379e12daba tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:22.414664 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0b685993-e37d-422f-98e3-98379e12daba tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:22.415432 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0b685993-e37d-422f-98e3-98379e12daba tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:22.415869 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0b685993-e37d-422f-98e3-98379e12daba tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:22.533163 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-0b685993-e37d-422f-98e3-98379e12daba tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:41:22.540277 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-0b685993-e37d-422f-98e3-98379e12daba tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1571 microversion: 2.1 time: 0.136599 Aug 27 01:41:22.540824 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 663/1266] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:41:22 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1571 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:41:23.557692 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c40795b2-93a0-4896-a1de-7e7ced8eb16f tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:23.558304 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c40795b2-93a0-4896-a1de-7e7ced8eb16f tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:23.564373 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c40795b2-93a0-4896-a1de-7e7ced8eb16f tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:23.564820 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c40795b2-93a0-4896-a1de-7e7ced8eb16f tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:23.565597 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c40795b2-93a0-4896-a1de-7e7ced8eb16f tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:23.566029 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c40795b2-93a0-4896-a1de-7e7ced8eb16f tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:23.691400 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c40795b2-93a0-4896-a1de-7e7ced8eb16f tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:41:23.698745 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c40795b2-93a0-4896-a1de-7e7ced8eb16f tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1571 microversion: 2.1 time: 0.144721 Aug 27 01:41:23.699394 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 604/1267] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:41:23 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1571 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:41:24.716004 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-fb42596f-1a4e-4c2a-ae82-e7036f0e374f tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:24.716559 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-fb42596f-1a4e-4c2a-ae82-e7036f0e374f tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:24.722912 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fb42596f-1a4e-4c2a-ae82-e7036f0e374f tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:24.723355 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fb42596f-1a4e-4c2a-ae82-e7036f0e374f tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:24.724115 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fb42596f-1a4e-4c2a-ae82-e7036f0e374f tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:24.724547 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fb42596f-1a4e-4c2a-ae82-e7036f0e374f tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:24.844218 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-fb42596f-1a4e-4c2a-ae82-e7036f0e374f tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:41:24.851484 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-fb42596f-1a4e-4c2a-ae82-e7036f0e374f tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1571 microversion: 2.1 time: 0.139228 Aug 27 01:41:24.852040 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 664/1268] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:41:24 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1571 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:41:25.868053 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-cc783851-146f-4e78-bc81-92b5d5a31004 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:25.868586 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-cc783851-146f-4e78-bc81-92b5d5a31004 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:25.875073 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cc783851-146f-4e78-bc81-92b5d5a31004 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:25.875517 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cc783851-146f-4e78-bc81-92b5d5a31004 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:25.876276 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cc783851-146f-4e78-bc81-92b5d5a31004 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:25.876708 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cc783851-146f-4e78-bc81-92b5d5a31004 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:25.995389 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-cc783851-146f-4e78-bc81-92b5d5a31004 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:41:26.002734 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-cc783851-146f-4e78-bc81-92b5d5a31004 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1571 microversion: 2.1 time: 0.138404 Aug 27 01:41:26.003287 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 605/1269] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:41:25 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1571 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:41:27.019175 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-8d3c5287-617b-4a69-b63b-061e4f9146cc tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:27.019788 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-8d3c5287-617b-4a69-b63b-061e4f9146cc tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:27.025676 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8d3c5287-617b-4a69-b63b-061e4f9146cc tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:27.026123 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8d3c5287-617b-4a69-b63b-061e4f9146cc tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:27.026886 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8d3c5287-617b-4a69-b63b-061e4f9146cc tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:27.027322 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8d3c5287-617b-4a69-b63b-061e4f9146cc tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:27.146168 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-8d3c5287-617b-4a69-b63b-061e4f9146cc tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:41:27.153388 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-8d3c5287-617b-4a69-b63b-061e4f9146cc tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1571 microversion: 2.1 time: 0.137842 Aug 27 01:41:27.153935 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 665/1270] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:41:27 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1571 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:41:28.170118 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-a917bf98-ffca-4e53-a12b-77dbbe2cab9a tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:28.171150 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-a917bf98-ffca-4e53-a12b-77dbbe2cab9a tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:28.176986 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a917bf98-ffca-4e53-a12b-77dbbe2cab9a tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:28.177428 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a917bf98-ffca-4e53-a12b-77dbbe2cab9a tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:28.178183 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a917bf98-ffca-4e53-a12b-77dbbe2cab9a tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:28.178611 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a917bf98-ffca-4e53-a12b-77dbbe2cab9a tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:28.295803 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-a917bf98-ffca-4e53-a12b-77dbbe2cab9a tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:41:28.303189 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-a917bf98-ffca-4e53-a12b-77dbbe2cab9a tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1571 microversion: 2.1 time: 0.136945 Aug 27 01:41:28.303746 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 606/1271] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:41:28 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1571 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:41:29.319903 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-fb76e737-3e52-4920-8f11-6a1e7646574c tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:29.320543 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-fb76e737-3e52-4920-8f11-6a1e7646574c tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:29.327078 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fb76e737-3e52-4920-8f11-6a1e7646574c tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:29.328104 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fb76e737-3e52-4920-8f11-6a1e7646574c tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:29.329168 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fb76e737-3e52-4920-8f11-6a1e7646574c tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:29.329461 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-fb76e737-3e52-4920-8f11-6a1e7646574c tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:29.447862 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-fb76e737-3e52-4920-8f11-6a1e7646574c tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:41:29.455801 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-fb76e737-3e52-4920-8f11-6a1e7646574c tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1571 microversion: 2.1 time: 0.139695 Aug 27 01:41:29.456352 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 666/1272] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:41:29 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1571 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:41:30.472539 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-e5fae40a-9b2b-4376-af04-8a1191af9089 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:30.473188 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-e5fae40a-9b2b-4376-af04-8a1191af9089 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:30.479307 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e5fae40a-9b2b-4376-af04-8a1191af9089 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:30.479753 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e5fae40a-9b2b-4376-af04-8a1191af9089 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:30.480534 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e5fae40a-9b2b-4376-af04-8a1191af9089 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:30.480995 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e5fae40a-9b2b-4376-af04-8a1191af9089 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:30.609492 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-e5fae40a-9b2b-4376-af04-8a1191af9089 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:41:30.614757 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-e5fae40a-9b2b-4376-af04-8a1191af9089 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1571 microversion: 2.1 time: 0.145914 Aug 27 01:41:30.615391 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 607/1273] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:41:30 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1571 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:41:31.631370 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4053ba0e-a868-4ca5-be37-027ee740b8fc tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:31.631980 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4053ba0e-a868-4ca5-be37-027ee740b8fc tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:31.637876 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4053ba0e-a868-4ca5-be37-027ee740b8fc tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:31.638314 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4053ba0e-a868-4ca5-be37-027ee740b8fc tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:31.639169 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4053ba0e-a868-4ca5-be37-027ee740b8fc tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:31.639594 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4053ba0e-a868-4ca5-be37-027ee740b8fc tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:31.763891 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4053ba0e-a868-4ca5-be37-027ee740b8fc tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:41:31.772258 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4053ba0e-a868-4ca5-be37-027ee740b8fc tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1571 microversion: 2.1 time: 0.144489 Aug 27 01:41:31.772817 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 667/1274] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:41:31 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1571 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:41:32.789314 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-17b51066-c36b-412d-985f-2ec28f92b505 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:32.792121 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-17b51066-c36b-412d-985f-2ec28f92b505 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:32.796316 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-17b51066-c36b-412d-985f-2ec28f92b505 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:32.796763 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-17b51066-c36b-412d-985f-2ec28f92b505 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:32.797619 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-17b51066-c36b-412d-985f-2ec28f92b505 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:32.798139 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-17b51066-c36b-412d-985f-2ec28f92b505 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:32.922870 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-17b51066-c36b-412d-985f-2ec28f92b505 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:41:32.930292 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-17b51066-c36b-412d-985f-2ec28f92b505 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1571 microversion: 2.1 time: 0.144606 Aug 27 01:41:32.931092 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 608/1275] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:41:32 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1571 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:41:33.947115 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-b106a0dd-a616-41d8-83b4-86b03dde4a69 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:33.947715 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-b106a0dd-a616-41d8-83b4-86b03dde4a69 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:33.953759 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b106a0dd-a616-41d8-83b4-86b03dde4a69 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:33.954195 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b106a0dd-a616-41d8-83b4-86b03dde4a69 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:33.954944 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b106a0dd-a616-41d8-83b4-86b03dde4a69 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:33.955375 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-b106a0dd-a616-41d8-83b4-86b03dde4a69 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:34.073640 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-b106a0dd-a616-41d8-83b4-86b03dde4a69 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:41:34.081685 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-b106a0dd-a616-41d8-83b4-86b03dde4a69 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1572 microversion: 2.1 time: 0.138201 Aug 27 01:41:34.082265 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 668/1276] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:41:33 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1572 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:41:34.097201 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-a53a1862-29ea-4671-b491-fc9c2ea1eb98 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:41:34.097770 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-a53a1862-29ea-4671-b491-fc9c2ea1eb98 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:34.103565 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a53a1862-29ea-4671-b491-fc9c2ea1eb98 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:34.104013 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a53a1862-29ea-4671-b491-fc9c2ea1eb98 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:34.104780 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a53a1862-29ea-4671-b491-fc9c2ea1eb98 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:34.105243 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-a53a1862-29ea-4671-b491-fc9c2ea1eb98 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:34.419618 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-a53a1862-29ea-4671-b491-fc9c2ea1eb98 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "POST /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3/action" status: 202 len: 0 microversion: 2.1 time: 0.326003 Aug 27 01:41:34.420595 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 609/1277] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Aug 27 01:41:34 2021] POST /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:41:34.429192 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-4779d9e5-cd32-45af-bf84-3c13145b9b65 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:34.429922 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-4779d9e5-cd32-45af-bf84-3c13145b9b65 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:34.435768 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4779d9e5-cd32-45af-bf84-3c13145b9b65 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:34.439507 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4779d9e5-cd32-45af-bf84-3c13145b9b65 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:34.439507 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4779d9e5-cd32-45af-bf84-3c13145b9b65 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:34.439507 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-4779d9e5-cd32-45af-bf84-3c13145b9b65 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:34.557138 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-4779d9e5-cd32-45af-bf84-3c13145b9b65 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:41:34.565036 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-4779d9e5-cd32-45af-bf84-3c13145b9b65 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1520 microversion: 2.1 time: 0.139423 Aug 27 01:41:34.565820 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 669/1278] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:41:34 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1520 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:41:35.582362 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-85472c22-78dd-460c-bfd6-c7e52d16d390 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:35.582974 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-85472c22-78dd-460c-bfd6-c7e52d16d390 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:35.588883 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-85472c22-78dd-460c-bfd6-c7e52d16d390 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:35.589301 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-85472c22-78dd-460c-bfd6-c7e52d16d390 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:35.590068 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-85472c22-78dd-460c-bfd6-c7e52d16d390 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:35.590506 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-85472c22-78dd-460c-bfd6-c7e52d16d390 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:35.633749 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-ef98b824-e70e-4a88-b646-3ca10470edeb req-af2e2f71-0d5f-4cfe-99a7-57679f693af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b043518-6eef-4325-8de3-ed41b0cafbd3", "name": "network-vif-unplugged", "status": "completed", "tag": "66ae3a5c-bed1-480a-8aa0-cda45f03b919"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:41:35.636973 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:41:35.636973 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:41:35.642614 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-ef98b824-e70e-4a88-b646-3ca10470edeb req-af2e2f71-0d5f-4cfe-99a7-57679f693af9 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:35.643061 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-ef98b824-e70e-4a88-b646-3ca10470edeb req-af2e2f71-0d5f-4cfe-99a7-57679f693af9 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:35.654376 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.compute.server_external_events [req-ef98b824-e70e-4a88-b646-3ca10470edeb req-af2e2f71-0d5f-4cfe-99a7-57679f693af9 service nova] Unable to find a host for instance 9b043518-6eef-4325-8de3-ed41b0cafbd3. Dropping event network-vif-unplugged {{(pid=108756) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Aug 27 01:41:35.656406 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-ef98b824-e70e-4a88-b646-3ca10470edeb req-af2e2f71-0d5f-4cfe-99a7-57679f693af9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.086769 Aug 27 01:41:35.657472 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 610/1279] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:41:35 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 89 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 27 01:41:35.730797 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-85472c22-78dd-460c-bfd6-c7e52d16d390 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:41:35.738888 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-85472c22-78dd-460c-bfd6-c7e52d16d390 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1522 microversion: 2.1 time: 0.160335 Aug 27 01:41:35.739438 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 670/1280] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:41:35 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:41:36.755635 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-5f9090a2-2073-436f-b85f-fa514dc378aa tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:36.756215 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-5f9090a2-2073-436f-b85f-fa514dc378aa tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:36.762020 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5f9090a2-2073-436f-b85f-fa514dc378aa tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:36.762459 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5f9090a2-2073-436f-b85f-fa514dc378aa tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:36.763225 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5f9090a2-2073-436f-b85f-fa514dc378aa tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:36.763684 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-5f9090a2-2073-436f-b85f-fa514dc378aa tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:36.881696 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-5f9090a2-2073-436f-b85f-fa514dc378aa tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:41:36.889018 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-5f9090a2-2073-436f-b85f-fa514dc378aa tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1578 microversion: 2.1 time: 0.137033 Aug 27 01:41:36.890104 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 611/1281] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:41:36 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1578 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:41:37.906688 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-a369abaa-1026-4862-a5da-b5bb9207cc4c tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:37.907314 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-a369abaa-1026-4862-a5da-b5bb9207cc4c tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:37.913045 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a369abaa-1026-4862-a5da-b5bb9207cc4c tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:37.913488 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a369abaa-1026-4862-a5da-b5bb9207cc4c tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:37.914239 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a369abaa-1026-4862-a5da-b5bb9207cc4c tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:37.914669 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a369abaa-1026-4862-a5da-b5bb9207cc4c tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:38.033980 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-a369abaa-1026-4862-a5da-b5bb9207cc4c tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:41:38.041156 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-a369abaa-1026-4862-a5da-b5bb9207cc4c tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1578 microversion: 2.1 time: 0.138854 Aug 27 01:41:38.041701 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 671/1282] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:41:37 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1578 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:41:39.058906 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-2840dfca-cd60-448c-9117-6696b94d3ed6 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:39.059545 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-2840dfca-cd60-448c-9117-6696b94d3ed6 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:39.066290 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2840dfca-cd60-448c-9117-6696b94d3ed6 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:39.066717 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2840dfca-cd60-448c-9117-6696b94d3ed6 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:39.067504 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2840dfca-cd60-448c-9117-6696b94d3ed6 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:39.067932 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-2840dfca-cd60-448c-9117-6696b94d3ed6 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:39.182713 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-2840dfca-cd60-448c-9117-6696b94d3ed6 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:41:39.190424 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-2840dfca-cd60-448c-9117-6696b94d3ed6 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1578 microversion: 2.1 time: 0.135195 Aug 27 01:41:39.190979 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 612/1283] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:41:39 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1578 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:41:40.207126 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-9acdd061-fb89-40f9-b100-47ce139f8f5d tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:40.207731 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-9acdd061-fb89-40f9-b100-47ce139f8f5d tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:40.213722 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9acdd061-fb89-40f9-b100-47ce139f8f5d tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:40.214168 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9acdd061-fb89-40f9-b100-47ce139f8f5d tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:40.214931 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9acdd061-fb89-40f9-b100-47ce139f8f5d tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:40.215388 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-9acdd061-fb89-40f9-b100-47ce139f8f5d tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:40.332924 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-9acdd061-fb89-40f9-b100-47ce139f8f5d tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:41:40.340129 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-9acdd061-fb89-40f9-b100-47ce139f8f5d tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1578 microversion: 2.1 time: 0.136629 Aug 27 01:41:40.340685 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 672/1284] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:41:40 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1578 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:41:41.357240 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-b9607820-374b-4a03-b710-b1677a00a2d9 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:41.357874 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-b9607820-374b-4a03-b710-b1677a00a2d9 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:41.364218 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b9607820-374b-4a03-b710-b1677a00a2d9 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:41.364654 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b9607820-374b-4a03-b710-b1677a00a2d9 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:41.365440 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b9607820-374b-4a03-b710-b1677a00a2d9 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:41.365867 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b9607820-374b-4a03-b710-b1677a00a2d9 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:41.638353 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-b9607820-374b-4a03-b710-b1677a00a2d9 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:41:41.645707 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-b9607820-374b-4a03-b710-b1677a00a2d9 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1578 microversion: 2.1 time: 0.292061 Aug 27 01:41:41.646264 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 613/1285] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:41:41 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1578 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:41:42.662180 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-e1b78f66-29ad-4625-a6a9-8b92ba6d13df tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:42.662772 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-e1b78f66-29ad-4625-a6a9-8b92ba6d13df tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:42.668554 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e1b78f66-29ad-4625-a6a9-8b92ba6d13df tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:42.668969 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e1b78f66-29ad-4625-a6a9-8b92ba6d13df tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:42.669736 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e1b78f66-29ad-4625-a6a9-8b92ba6d13df tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:42.670416 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e1b78f66-29ad-4625-a6a9-8b92ba6d13df tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:42.791140 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-e1b78f66-29ad-4625-a6a9-8b92ba6d13df tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:41:42.799136 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-e1b78f66-29ad-4625-a6a9-8b92ba6d13df tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1578 microversion: 2.1 time: 0.140611 Aug 27 01:41:42.799688 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 673/1286] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:41:42 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1578 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:41:43.815323 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-42e13932-06b6-4505-a764-86a48e8f6d50 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:43.815864 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-42e13932-06b6-4505-a764-86a48e8f6d50 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:43.821739 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-42e13932-06b6-4505-a764-86a48e8f6d50 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:43.822180 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-42e13932-06b6-4505-a764-86a48e8f6d50 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:43.822930 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-42e13932-06b6-4505-a764-86a48e8f6d50 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:43.823363 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-42e13932-06b6-4505-a764-86a48e8f6d50 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:43.946392 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-42e13932-06b6-4505-a764-86a48e8f6d50 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:41:43.954270 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-42e13932-06b6-4505-a764-86a48e8f6d50 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1578 microversion: 2.1 time: 0.142720 Aug 27 01:41:43.954809 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 614/1287] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:41:43 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1578 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:41:44.970518 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-c2a06315-4e8e-43bd-906b-a74756935579 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:44.971054 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-c2a06315-4e8e-43bd-906b-a74756935579 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:44.976972 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c2a06315-4e8e-43bd-906b-a74756935579 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:44.977418 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c2a06315-4e8e-43bd-906b-a74756935579 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:44.978182 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c2a06315-4e8e-43bd-906b-a74756935579 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:44.978618 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c2a06315-4e8e-43bd-906b-a74756935579 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:45.095493 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-c2a06315-4e8e-43bd-906b-a74756935579 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:41:45.102736 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-c2a06315-4e8e-43bd-906b-a74756935579 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1578 microversion: 2.1 time: 0.136028 Aug 27 01:41:45.103289 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 674/1288] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:41:44 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1578 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:41:46.119489 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-716e3897-6877-4f97-959a-e850d9e057e0 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:46.120239 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-716e3897-6877-4f97-959a-e850d9e057e0 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:46.126981 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-716e3897-6877-4f97-959a-e850d9e057e0 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:46.127425 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-716e3897-6877-4f97-959a-e850d9e057e0 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:46.128185 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-716e3897-6877-4f97-959a-e850d9e057e0 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:46.128610 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-716e3897-6877-4f97-959a-e850d9e057e0 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:46.245718 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-716e3897-6877-4f97-959a-e850d9e057e0 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:41:46.254194 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-716e3897-6877-4f97-959a-e850d9e057e0 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1578 microversion: 2.1 time: 0.138570 Aug 27 01:41:46.254756 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 615/1289] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:41:46 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1578 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:41:47.271174 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-256332cc-4964-4707-8cbd-3e1d138384a5 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:47.271804 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-256332cc-4964-4707-8cbd-3e1d138384a5 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:47.277643 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-256332cc-4964-4707-8cbd-3e1d138384a5 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:47.278079 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-256332cc-4964-4707-8cbd-3e1d138384a5 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:47.278824 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-256332cc-4964-4707-8cbd-3e1d138384a5 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:47.279248 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-256332cc-4964-4707-8cbd-3e1d138384a5 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:47.398995 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-256332cc-4964-4707-8cbd-3e1d138384a5 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:41:47.406000 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-256332cc-4964-4707-8cbd-3e1d138384a5 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1578 microversion: 2.1 time: 0.138621 Aug 27 01:41:47.407066 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 675/1290] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:41:47 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1578 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:41:47.692405 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-4aab4653-e65c-4ff5-b188-5be5e8634fe0 req-11ec052e-3772-4bf5-b4ac-03989c4cdb87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b043518-6eef-4325-8de3-ed41b0cafbd3", "name": "network-vif-plugged", "status": "completed", "tag": "66ae3a5c-bed1-480a-8aa0-cda45f03b919"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:41:47.693841 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:41:47.693841 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:41:47.701827 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-4aab4653-e65c-4ff5-b188-5be5e8634fe0 req-11ec052e-3772-4bf5-b4ac-03989c4cdb87 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:47.702290 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-4aab4653-e65c-4ff5-b188-5be5e8634fe0 req-11ec052e-3772-4bf5-b4ac-03989c4cdb87 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:47.717448 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-4aab4653-e65c-4ff5-b188-5be5e8634fe0 req-11ec052e-3772-4bf5-b4ac-03989c4cdb87 service nova] Creating event network-vif-plugged:66ae3a5c-bed1-480a-8aa0-cda45f03b919 for instance 9b043518-6eef-4325-8de3-ed41b0cafbd3 on hv-cinder-75916 Aug 27 01:41:47.723857 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-4aab4653-e65c-4ff5-b188-5be5e8634fe0 req-11ec052e-3772-4bf5-b4ac-03989c4cdb87 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035316 Aug 27 01:41:47.724424 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 616/1291] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:41:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:41:48.423357 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-ad5921ca-5a40-46c3-98aa-b5ff8f5ee07b tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:48.423964 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-ad5921ca-5a40-46c3-98aa-b5ff8f5ee07b tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:48.429793 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ad5921ca-5a40-46c3-98aa-b5ff8f5ee07b tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:48.430236 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ad5921ca-5a40-46c3-98aa-b5ff8f5ee07b tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:48.431002 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ad5921ca-5a40-46c3-98aa-b5ff8f5ee07b tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:48.431432 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ad5921ca-5a40-46c3-98aa-b5ff8f5ee07b tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:48.549849 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-ad5921ca-5a40-46c3-98aa-b5ff8f5ee07b tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:41:48.557418 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-ad5921ca-5a40-46c3-98aa-b5ff8f5ee07b tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1578 microversion: 2.1 time: 0.138028 Aug 27 01:41:48.557975 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 676/1292] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:41:48 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1578 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:41:49.576368 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-435cf61a-2f0d-480e-98bb-a1fd9c8a7bc5 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:49.577164 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-435cf61a-2f0d-480e-98bb-a1fd9c8a7bc5 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:49.584434 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-435cf61a-2f0d-480e-98bb-a1fd9c8a7bc5 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:49.584945 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-435cf61a-2f0d-480e-98bb-a1fd9c8a7bc5 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:49.585801 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-435cf61a-2f0d-480e-98bb-a1fd9c8a7bc5 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:49.586290 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-435cf61a-2f0d-480e-98bb-a1fd9c8a7bc5 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:49.717074 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-435cf61a-2f0d-480e-98bb-a1fd9c8a7bc5 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:41:49.725028 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-435cf61a-2f0d-480e-98bb-a1fd9c8a7bc5 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1565 microversion: 2.1 time: 0.153089 Aug 27 01:41:49.725573 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 617/1293] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:41:49 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:41:57.998233 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-062bc38c-a7dc-4e72-8c19-5a6caf422ec2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:57.998765 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-062bc38c-a7dc-4e72-8c19-5a6caf422ec2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: b1462288-b9a8-48fe-9593-e9572fd0b7ba] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:58.005213 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-062bc38c-a7dc-4e72-8c19-5a6caf422ec2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:58.005653 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-062bc38c-a7dc-4e72-8c19-5a6caf422ec2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:58.006409 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-062bc38c-a7dc-4e72-8c19-5a6caf422ec2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:58.006866 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-062bc38c-a7dc-4e72-8c19-5a6caf422ec2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:58.031147 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-062bc38c-a7dc-4e72-8c19-5a6caf422ec2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: b1462288-b9a8-48fe-9593-e9572fd0b7ba] Going to try to terminate instance {{(pid=108755) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 01:41:58.394944 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 01:41:58.395150 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: Fri Aug 27 01:41:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba (ip 10.222.0.25) !!! Aug 27 01:41:58.407473 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-062bc38c-a7dc-4e72-8c19-5a6caf422ec2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba" status: 204 len: 0 microversion: 2.1 time: 0.412738 Aug 27 01:41:58.409266 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 677/1294] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Aug 27 01:41:57 2021] DELETE /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 01:41:58.417133 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-b4eda899-c32f-4878-adb0-2b7e148a2fb0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:58.417761 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-b4eda899-c32f-4878-adb0-2b7e148a2fb0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: b1462288-b9a8-48fe-9593-e9572fd0b7ba] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:58.425145 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b4eda899-c32f-4878-adb0-2b7e148a2fb0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:58.425595 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b4eda899-c32f-4878-adb0-2b7e148a2fb0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:58.426375 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b4eda899-c32f-4878-adb0-2b7e148a2fb0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:58.426808 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b4eda899-c32f-4878-adb0-2b7e148a2fb0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:58.545535 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-b4eda899-c32f-4878-adb0-2b7e148a2fb0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:41:58.552826 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-b4eda899-c32f-4878-adb0-2b7e148a2fb0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba" status: 200 len: 1577 microversion: 2.1 time: 0.139370 Aug 27 01:41:58.553399 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 618/1295] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:41:58 2021] GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba => generated 1577 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:41:59.570932 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-88134ac4-d522-4afd-a23c-ec6d0e5a496e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:41:59.571663 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-88134ac4-d522-4afd-a23c-ec6d0e5a496e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: b1462288-b9a8-48fe-9593-e9572fd0b7ba] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:41:59.577547 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-88134ac4-d522-4afd-a23c-ec6d0e5a496e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:59.577986 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-88134ac4-d522-4afd-a23c-ec6d0e5a496e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:59.578748 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-88134ac4-d522-4afd-a23c-ec6d0e5a496e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:41:59.579177 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-88134ac4-d522-4afd-a23c-ec6d0e5a496e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:41:59.697152 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-88134ac4-d522-4afd-a23c-ec6d0e5a496e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:41:59.704672 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-88134ac4-d522-4afd-a23c-ec6d0e5a496e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba" status: 200 len: 1577 microversion: 2.1 time: 0.137900 Aug 27 01:41:59.705261 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 678/1296] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:41:59 2021] GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba => generated 1577 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:42:00.721372 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-d7efe4dd-9d88-4e78-a41c-19c0464cab5a tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:42:00.722010 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-d7efe4dd-9d88-4e78-a41c-19c0464cab5a tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: b1462288-b9a8-48fe-9593-e9572fd0b7ba] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:42:00.727739 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d7efe4dd-9d88-4e78-a41c-19c0464cab5a tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:00.728182 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d7efe4dd-9d88-4e78-a41c-19c0464cab5a tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:00.728957 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d7efe4dd-9d88-4e78-a41c-19c0464cab5a tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:00.729390 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d7efe4dd-9d88-4e78-a41c-19c0464cab5a tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:00.789843 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-d7efe4dd-9d88-4e78-a41c-19c0464cab5a tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:42:00.798425 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-d7efe4dd-9d88-4e78-a41c-19c0464cab5a tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba" status: 200 len: 1509 microversion: 2.1 time: 0.080911 Aug 27 01:42:00.798988 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 619/1297] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:42:00 2021] GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba => generated 1509 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:42:01.139413 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-e19ad0d6-111e-4243-b8e6-685353195b85 req-3e601399-260e-49f1-b513-c57687906c96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1462288-b9a8-48fe-9593-e9572fd0b7ba", "name": "network-vif-deleted", "tag": "dac3e0d4-350a-4e21-a74f-eeb422da3bd7"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:42:01.143764 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:42:01.143764 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:42:01.148600 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-e19ad0d6-111e-4243-b8e6-685353195b85 req-3e601399-260e-49f1-b513-c57687906c96 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:01.149504 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-e19ad0d6-111e-4243-b8e6-685353195b85 req-3e601399-260e-49f1-b513-c57687906c96 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:01.168016 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-e19ad0d6-111e-4243-b8e6-685353195b85 req-3e601399-260e-49f1-b513-c57687906c96 service nova] Creating event network-vif-deleted:dac3e0d4-350a-4e21-a74f-eeb422da3bd7 for instance b1462288-b9a8-48fe-9593-e9572fd0b7ba on hv-cinder-75916 Aug 27 01:42:01.174805 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-e19ad0d6-111e-4243-b8e6-685353195b85 req-3e601399-260e-49f1-b513-c57687906c96 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093345 Aug 27 01:42:01.175747 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 679/1298] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:42:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:42:01.816019 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-73a6fef1-8ac2-46f9-bd18-95fd0d004753 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:42:01.816612 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-73a6fef1-8ac2-46f9-bd18-95fd0d004753 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: b1462288-b9a8-48fe-9593-e9572fd0b7ba] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:42:01.822840 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-73a6fef1-8ac2-46f9-bd18-95fd0d004753 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:01.823293 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-73a6fef1-8ac2-46f9-bd18-95fd0d004753 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:01.824081 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-73a6fef1-8ac2-46f9-bd18-95fd0d004753 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:01.824521 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-73a6fef1-8ac2-46f9-bd18-95fd0d004753 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:01.855608 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-73a6fef1-8ac2-46f9-bd18-95fd0d004753 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:01.856076 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-73a6fef1-8ac2-46f9-bd18-95fd0d004753 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:01.856532 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.objects.instance [None req-73a6fef1-8ac2-46f9-bd18-95fd0d004753 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lazy-loading 'fault' on Instance uuid b1462288-b9a8-48fe-9593-e9572fd0b7ba {{(pid=108756) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:42:01.902493 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-73a6fef1-8ac2-46f9-bd18-95fd0d004753 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:42:01.907222 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-73a6fef1-8ac2-46f9-bd18-95fd0d004753 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba" status: 200 len: 1230 microversion: 2.1 time: 0.095460 Aug 27 01:42:01.907790 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 620/1299] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:42:01 2021] GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:42:02.924352 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-ada7485b-4044-4481-be0c-562826ae0ed0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:42:02.925079 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-ada7485b-4044-4481-be0c-562826ae0ed0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: b1462288-b9a8-48fe-9593-e9572fd0b7ba] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:42:02.931158 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ada7485b-4044-4481-be0c-562826ae0ed0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:02.931603 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ada7485b-4044-4481-be0c-562826ae0ed0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:02.932362 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ada7485b-4044-4481-be0c-562826ae0ed0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:02.932804 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ada7485b-4044-4481-be0c-562826ae0ed0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:02.946070 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.wsgi [None req-ada7485b-4044-4481-be0c-562826ae0ed0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] HTTP exception thrown: Instance b1462288-b9a8-48fe-9593-e9572fd0b7ba could not be found. Aug 27 01:42:02.946645 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-ada7485b-4044-4481-be0c-562826ae0ed0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Returning 404 to user: Instance b1462288-b9a8-48fe-9593-e9572fd0b7ba could not be found. {{(pid=108755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:42:02.947447 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-ada7485b-4044-4481-be0c-562826ae0ed0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba" status: 404 len: 111 microversion: 2.1 time: 0.027478 Aug 27 01:42:02.947952 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 680/1300] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:42:02 2021] GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:42:02.992821 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-0c764941-1718-493b-a904-6d4c7e3b0046 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2005007096", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1188750384", "security_groups": [{"name": "tempest-secgroup-smoke-1562836854"}], "block_device_mapping_v2": [{"uuid": "0db8cdad-179f-4cbd-8d33-0acc8fe9a6f5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "36f8a83c-fcee-45f1-9a2d-3d2de8a9383c"}]}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:42:03.093068 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.network.neutron [None req-0c764941-1718-493b-a904-6d4c7e3b0046 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] validate_networks() for [('36f8a83c-fcee-45f1-9a2d-3d2de8a9383c', None, None, None, None, None)] {{(pid=108756) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 01:42:03.497392 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-0c764941-1718-493b-a904-6d4c7e3b0046 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Flavor limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 01:42:03.497811 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-0c764941-1718-493b-a904-6d4c7e3b0046 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Image limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 01:42:03.498278 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-0c764941-1718-493b-a904-6d4c7e3b0046 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Flavor pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 01:42:03.498680 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-0c764941-1718-493b-a904-6d4c7e3b0046 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Image pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 01:42:03.499108 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-0c764941-1718-493b-a904-6d4c7e3b0046 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 01:42:03.508404 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0c764941-1718-493b-a904-6d4c7e3b0046 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:03.508867 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0c764941-1718-493b-a904-6d4c7e3b0046 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:03.509674 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0c764941-1718-493b-a904-6d4c7e3b0046 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:03.510107 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0c764941-1718-493b-a904-6d4c7e3b0046 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:03.525739 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-0c764941-1718-493b-a904-6d4c7e3b0046 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Getting quotas for project e450a8d39c6c4bc1aa95f2240bf96927. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:42:03.529585 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-0c764941-1718-493b-a904-6d4c7e3b0046 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Getting quotas for user a6b922afb576470db214cfe37258a289 and project e450a8d39c6c4bc1aa95f2240bf96927. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:42:03.589461 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-0c764941-1718-493b-a904-6d4c7e3b0046 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Going to run 1 instances... {{(pid=108756) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 01:42:03.591538 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-0c764941-1718-493b-a904-6d4c7e3b0046 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: 9a473973-cb03-4335-bad0-618c98df77cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0db8cdad-179f-4cbd-8d33-0acc8fe9a6f5',volume_size=None,volume_type=None)] {{(pid=108756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 01:42:04.087192 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-0c764941-1718-493b-a904-6d4c7e3b0046 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.097895 Aug 27 01:42:04.088001 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 621/1301] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Aug 27 01:42:02 2021] POST /compute/v2.1/servers => generated 406 bytes in 1099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 01:42:04.098028 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-6174f6d5-9bcd-4e4f-a351-857b45128457 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:42:04.098621 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-6174f6d5-9bcd-4e4f-a351-857b45128457 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: 9a473973-cb03-4335-bad0-618c98df77cd] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:42:04.155110 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-6174f6d5-9bcd-4e4f-a351-857b45128457 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:42:04.161889 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-6174f6d5-9bcd-4e4f-a351-857b45128457 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd" status: 200 len: 1095 microversion: 2.1 time: 0.067503 Aug 27 01:42:04.162573 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 681/1302] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:42:04 2021] GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:42:05.179651 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-6171b8e1-118c-4652-a49b-468baac7da42 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:42:05.180269 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-6171b8e1-118c-4652-a49b-468baac7da42 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: 9a473973-cb03-4335-bad0-618c98df77cd] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:42:05.186684 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6171b8e1-118c-4652-a49b-468baac7da42 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:05.187145 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6171b8e1-118c-4652-a49b-468baac7da42 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:05.187984 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6171b8e1-118c-4652-a49b-468baac7da42 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:05.188584 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-6171b8e1-118c-4652-a49b-468baac7da42 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:05.508255 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-6171b8e1-118c-4652-a49b-468baac7da42 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:42:05.515500 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-6171b8e1-118c-4652-a49b-468baac7da42 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd" status: 200 len: 1145 microversion: 2.1 time: 0.339724 Aug 27 01:42:05.516061 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 622/1303] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:42:05 2021] GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd => generated 1145 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:42:06.531527 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-efe9015b-497b-4634-8738-1ee1897295c5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:42:06.532187 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-efe9015b-497b-4634-8738-1ee1897295c5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: 9a473973-cb03-4335-bad0-618c98df77cd] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:42:06.538598 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-efe9015b-497b-4634-8738-1ee1897295c5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:06.539042 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-efe9015b-497b-4634-8738-1ee1897295c5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:06.539799 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-efe9015b-497b-4634-8738-1ee1897295c5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:06.540228 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-efe9015b-497b-4634-8738-1ee1897295c5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:06.605325 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-efe9015b-497b-4634-8738-1ee1897295c5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:42:06.613310 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-efe9015b-497b-4634-8738-1ee1897295c5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd" status: 200 len: 1211 microversion: 2.1 time: 0.085627 Aug 27 01:42:06.613872 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 682/1304] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:42:06 2021] GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd => generated 1211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:42:07.631278 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-b7c08abe-4d67-4629-b12b-d3e075afe12d tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:42:07.632669 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-b7c08abe-4d67-4629-b12b-d3e075afe12d tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: 9a473973-cb03-4335-bad0-618c98df77cd] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:42:07.639288 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b7c08abe-4d67-4629-b12b-d3e075afe12d tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:07.639743 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b7c08abe-4d67-4629-b12b-d3e075afe12d tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:07.640603 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b7c08abe-4d67-4629-b12b-d3e075afe12d tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:07.641627 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b7c08abe-4d67-4629-b12b-d3e075afe12d tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:07.781362 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-b7c08abe-4d67-4629-b12b-d3e075afe12d tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:42:07.789541 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-b7c08abe-4d67-4629-b12b-d3e075afe12d tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd" status: 200 len: 1279 microversion: 2.1 time: 0.162359 Aug 27 01:42:07.805078 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 623/1305] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:42:07 2021] GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd => generated 1279 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:42:07.833544 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-8b4d3cf2-11d8-47a5-8617-d65a2056b4d5 req-80bc2916-c2eb-4801-b465-1fbb5cee1f42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a473973-cb03-4335-bad0-618c98df77cd", "tag": "f3304d45-9af7-4da5-8afa-fdd205afecba"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:42:07.835851 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:42:07.835851 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:42:07.843039 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-8b4d3cf2-11d8-47a5-8617-d65a2056b4d5 req-80bc2916-c2eb-4801-b465-1fbb5cee1f42 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:07.843761 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-8b4d3cf2-11d8-47a5-8617-d65a2056b4d5 req-80bc2916-c2eb-4801-b465-1fbb5cee1f42 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:07.856305 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-8b4d3cf2-11d8-47a5-8617-d65a2056b4d5 req-80bc2916-c2eb-4801-b465-1fbb5cee1f42 service nova] Creating event network-changed:f3304d45-9af7-4da5-8afa-fdd205afecba for instance 9a473973-cb03-4335-bad0-618c98df77cd on hv-cinder-75916 Aug 27 01:42:07.864467 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-8b4d3cf2-11d8-47a5-8617-d65a2056b4d5 req-80bc2916-c2eb-4801-b465-1fbb5cee1f42 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036628 Aug 27 01:42:07.865011 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 683/1306] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:42:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:42:08.805385 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-b2e592aa-b96e-4526-96d1-3c23816942eb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:42:08.805993 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-b2e592aa-b96e-4526-96d1-3c23816942eb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: 9a473973-cb03-4335-bad0-618c98df77cd] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:42:08.811771 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b2e592aa-b96e-4526-96d1-3c23816942eb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:08.812218 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b2e592aa-b96e-4526-96d1-3c23816942eb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:08.813275 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b2e592aa-b96e-4526-96d1-3c23816942eb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:08.813714 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b2e592aa-b96e-4526-96d1-3c23816942eb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:08.935087 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-b2e592aa-b96e-4526-96d1-3c23816942eb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:42:08.942265 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-b2e592aa-b96e-4526-96d1-3c23816942eb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd" status: 200 len: 1267 microversion: 2.1 time: 0.140583 Aug 27 01:42:08.942846 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 624/1307] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:42:08 2021] GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:42:09.959452 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-2d180743-399b-4edf-984a-e84c1be8506e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:42:09.960139 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-2d180743-399b-4edf-984a-e84c1be8506e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: 9a473973-cb03-4335-bad0-618c98df77cd] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:42:09.966141 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2d180743-399b-4edf-984a-e84c1be8506e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:09.966614 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2d180743-399b-4edf-984a-e84c1be8506e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:09.967364 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2d180743-399b-4edf-984a-e84c1be8506e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:09.967795 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2d180743-399b-4edf-984a-e84c1be8506e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:10.089995 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-2d180743-399b-4edf-984a-e84c1be8506e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:42:10.098460 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-2d180743-399b-4edf-984a-e84c1be8506e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd" status: 200 len: 1267 microversion: 2.1 time: 0.142956 Aug 27 01:42:10.099016 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 684/1308] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:42:09 2021] GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd => generated 1267 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:42:11.114829 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-32696907-7b20-47b6-ba83-f923a90cad35 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:42:11.115435 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-32696907-7b20-47b6-ba83-f923a90cad35 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: 9a473973-cb03-4335-bad0-618c98df77cd] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:42:11.121301 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-32696907-7b20-47b6-ba83-f923a90cad35 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:11.122119 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-32696907-7b20-47b6-ba83-f923a90cad35 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:11.122504 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-32696907-7b20-47b6-ba83-f923a90cad35 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:11.122938 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-32696907-7b20-47b6-ba83-f923a90cad35 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:11.243246 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-32696907-7b20-47b6-ba83-f923a90cad35 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:42:11.250952 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-32696907-7b20-47b6-ba83-f923a90cad35 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd" status: 200 len: 1267 microversion: 2.1 time: 0.139265 Aug 27 01:42:11.251645 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 625/1309] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:42:11 2021] GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:42:12.267296 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-98175cc8-a935-4558-afc5-2de9cd323123 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:42:12.267930 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-98175cc8-a935-4558-afc5-2de9cd323123 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: 9a473973-cb03-4335-bad0-618c98df77cd] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:42:12.273646 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-98175cc8-a935-4558-afc5-2de9cd323123 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:12.274092 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-98175cc8-a935-4558-afc5-2de9cd323123 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:12.274857 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-98175cc8-a935-4558-afc5-2de9cd323123 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:12.275291 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-98175cc8-a935-4558-afc5-2de9cd323123 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:12.394691 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-98175cc8-a935-4558-afc5-2de9cd323123 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:42:12.401997 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-98175cc8-a935-4558-afc5-2de9cd323123 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd" status: 200 len: 1267 microversion: 2.1 time: 0.139008 Aug 27 01:42:12.402544 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 685/1310] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:42:12 2021] GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd => generated 1267 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:42:13.418535 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-af100384-a04f-44e7-8abc-79be333d5038 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:42:13.419175 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-af100384-a04f-44e7-8abc-79be333d5038 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: 9a473973-cb03-4335-bad0-618c98df77cd] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:42:13.426359 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-af100384-a04f-44e7-8abc-79be333d5038 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:13.426804 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-af100384-a04f-44e7-8abc-79be333d5038 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:13.427574 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-af100384-a04f-44e7-8abc-79be333d5038 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:13.428005 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-af100384-a04f-44e7-8abc-79be333d5038 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:13.542951 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-af100384-a04f-44e7-8abc-79be333d5038 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:42:13.550417 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-af100384-a04f-44e7-8abc-79be333d5038 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd" status: 200 len: 1267 microversion: 2.1 time: 0.135534 Aug 27 01:42:13.550977 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 626/1311] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:42:13 2021] GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:42:14.263743 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 01:42:14.264267 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: Fri Aug 27 01:42:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 01:42:14.567223 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-304065b9-9ee8-49cb-8c77-2f84642d4621 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:42:14.567825 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-304065b9-9ee8-49cb-8c77-2f84642d4621 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: 9a473973-cb03-4335-bad0-618c98df77cd] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:42:14.573647 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-304065b9-9ee8-49cb-8c77-2f84642d4621 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:14.574086 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-304065b9-9ee8-49cb-8c77-2f84642d4621 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:14.574838 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-304065b9-9ee8-49cb-8c77-2f84642d4621 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:14.575264 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-304065b9-9ee8-49cb-8c77-2f84642d4621 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:14.699278 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-304065b9-9ee8-49cb-8c77-2f84642d4621 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:42:14.706571 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-304065b9-9ee8-49cb-8c77-2f84642d4621 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd" status: 200 len: 1267 microversion: 2.1 time: 0.143637 Aug 27 01:42:14.707119 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 686/1312] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:42:14 2021] GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd => generated 1267 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:42:15.723519 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-72984197-4149-4bd5-910a-a02aed193f59 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:42:15.724120 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-72984197-4149-4bd5-910a-a02aed193f59 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: 9a473973-cb03-4335-bad0-618c98df77cd] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:42:15.726571 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b9a2838d-0571-43fc-b3f1-3ac37eecd7c4] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 01:42:15.730849 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-72984197-4149-4bd5-910a-a02aed193f59 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:15.731289 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-72984197-4149-4bd5-910a-a02aed193f59 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:15.732045 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-72984197-4149-4bd5-910a-a02aed193f59 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:15.732473 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-72984197-4149-4bd5-910a-a02aed193f59 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:15.857821 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-72984197-4149-4bd5-910a-a02aed193f59 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:42:15.865187 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-72984197-4149-4bd5-910a-a02aed193f59 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd" status: 200 len: 1267 microversion: 2.1 time: 0.145347 Aug 27 01:42:15.865748 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 627/1313] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:42:15 2021] GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:42:16.881525 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-8838c75e-7310-48ab-bee0-d62d83448021 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:42:16.882125 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-8838c75e-7310-48ab-bee0-d62d83448021 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: 9a473973-cb03-4335-bad0-618c98df77cd] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:42:16.887900 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8838c75e-7310-48ab-bee0-d62d83448021 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:16.888341 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8838c75e-7310-48ab-bee0-d62d83448021 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:16.889127 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8838c75e-7310-48ab-bee0-d62d83448021 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:16.889561 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-8838c75e-7310-48ab-bee0-d62d83448021 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:17.009549 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-8838c75e-7310-48ab-bee0-d62d83448021 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:42:17.016666 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-8838c75e-7310-48ab-bee0-d62d83448021 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd" status: 200 len: 1267 microversion: 2.1 time: 0.138908 Aug 27 01:42:17.017232 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 687/1314] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:42:16 2021] GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd => generated 1267 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:42:17.931446 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-d15f40eb-e266-471c-8db3-be334e96eafb req-b017d60b-49e5-45a9-8e94-073a6a847506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a473973-cb03-4335-bad0-618c98df77cd", "name": "network-vif-plugged", "status": "completed", "tag": "f3304d45-9af7-4da5-8afa-fdd205afecba"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:42:17.933067 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:42:17.933067 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:42:17.954874 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-d15f40eb-e266-471c-8db3-be334e96eafb req-b017d60b-49e5-45a9-8e94-073a6a847506 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:17.959486 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-d15f40eb-e266-471c-8db3-be334e96eafb req-b017d60b-49e5-45a9-8e94-073a6a847506 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:17.966631 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO oslo.messaging._drivers.impl_rabbit [-] [b9a2838d-0571-43fc-b3f1-3ac37eecd7c4] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 32992. Aug 27 01:42:17.969840 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-d15f40eb-e266-471c-8db3-be334e96eafb req-b017d60b-49e5-45a9-8e94-073a6a847506 service nova] Creating event network-vif-plugged:f3304d45-9af7-4da5-8afa-fdd205afecba for instance 9a473973-cb03-4335-bad0-618c98df77cd on hv-cinder-75916 Aug 27 01:42:17.976126 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-d15f40eb-e266-471c-8db3-be334e96eafb req-b017d60b-49e5-45a9-8e94-073a6a847506 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048311 Aug 27 01:42:17.976695 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 628/1315] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:42:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:42:18.033490 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-0f1f5144-6d6c-447c-8ea3-4506545f25ab tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:42:18.038133 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-0f1f5144-6d6c-447c-8ea3-4506545f25ab tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: 9a473973-cb03-4335-bad0-618c98df77cd] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:42:18.044302 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0f1f5144-6d6c-447c-8ea3-4506545f25ab tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:18.045207 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0f1f5144-6d6c-447c-8ea3-4506545f25ab tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:18.045986 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0f1f5144-6d6c-447c-8ea3-4506545f25ab tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:18.046462 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0f1f5144-6d6c-447c-8ea3-4506545f25ab tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:18.166008 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-0f1f5144-6d6c-447c-8ea3-4506545f25ab tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:42:18.174297 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-0f1f5144-6d6c-447c-8ea3-4506545f25ab tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd" status: 200 len: 1267 microversion: 2.1 time: 0.144320 Aug 27 01:42:18.174849 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 688/1316] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:42:18 2021] GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:42:19.192182 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ebe8632d-0e94-400b-95ab-7172a52b0bde tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:42:19.192935 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-ebe8632d-0e94-400b-95ab-7172a52b0bde tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: 9a473973-cb03-4335-bad0-618c98df77cd] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:42:19.199015 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ebe8632d-0e94-400b-95ab-7172a52b0bde tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:19.199467 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ebe8632d-0e94-400b-95ab-7172a52b0bde tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:19.200237 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ebe8632d-0e94-400b-95ab-7172a52b0bde tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:19.200673 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ebe8632d-0e94-400b-95ab-7172a52b0bde tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:19.332709 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ebe8632d-0e94-400b-95ab-7172a52b0bde tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:42:19.340080 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-ebe8632d-0e94-400b-95ab-7172a52b0bde tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd" status: 200 len: 1267 microversion: 2.1 time: 0.152947 Aug 27 01:42:19.340649 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 629/1317] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:42:19 2021] GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:42:20.357044 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-c3ffbbf2-7043-45f5-bec0-534f35f308c9 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:42:20.357655 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-c3ffbbf2-7043-45f5-bec0-534f35f308c9 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: 9a473973-cb03-4335-bad0-618c98df77cd] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:42:20.363970 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c3ffbbf2-7043-45f5-bec0-534f35f308c9 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:20.364415 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c3ffbbf2-7043-45f5-bec0-534f35f308c9 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:20.365201 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c3ffbbf2-7043-45f5-bec0-534f35f308c9 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:20.365635 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-c3ffbbf2-7043-45f5-bec0-534f35f308c9 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:20.486681 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-c3ffbbf2-7043-45f5-bec0-534f35f308c9 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:42:20.493875 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-c3ffbbf2-7043-45f5-bec0-534f35f308c9 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd" status: 200 len: 1455 microversion: 2.1 time: 0.140485 Aug 27 01:42:20.494423 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 689/1318] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:42:20 2021] GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd => generated 1455 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:42:20.509569 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-009884e1-bfd3-467c-94be-fb7227ce97a2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:42:20.510181 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-009884e1-bfd3-467c-94be-fb7227ce97a2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: 9a473973-cb03-4335-bad0-618c98df77cd] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:42:20.515929 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-009884e1-bfd3-467c-94be-fb7227ce97a2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:20.516370 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-009884e1-bfd3-467c-94be-fb7227ce97a2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:20.517157 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-009884e1-bfd3-467c-94be-fb7227ce97a2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:20.517593 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-009884e1-bfd3-467c-94be-fb7227ce97a2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:20.632467 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-009884e1-bfd3-467c-94be-fb7227ce97a2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:42:20.639785 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-009884e1-bfd3-467c-94be-fb7227ce97a2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd" status: 200 len: 1455 microversion: 2.1 time: 0.133809 Aug 27 01:42:20.640340 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 630/1319] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:42:20 2021] GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd => generated 1455 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:42:22.769256 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-6442dc90-338f-4c7d-b7f3-568c7b1c85fd req-30281a60-0dda-4fd8-a586-44f91b1d7b56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a473973-cb03-4335-bad0-618c98df77cd", "tag": "f3304d45-9af7-4da5-8afa-fdd205afecba"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:42:22.770812 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:42:22.770812 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:42:22.778272 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-6442dc90-338f-4c7d-b7f3-568c7b1c85fd req-30281a60-0dda-4fd8-a586-44f91b1d7b56 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:42:22.778713 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-6442dc90-338f-4c7d-b7f3-568c7b1c85fd req-30281a60-0dda-4fd8-a586-44f91b1d7b56 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:42:22.790603 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-6442dc90-338f-4c7d-b7f3-568c7b1c85fd req-30281a60-0dda-4fd8-a586-44f91b1d7b56 service nova] Creating event network-changed:f3304d45-9af7-4da5-8afa-fdd205afecba for instance 9a473973-cb03-4335-bad0-618c98df77cd on hv-cinder-75916 Aug 27 01:42:22.796078 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-6442dc90-338f-4c7d-b7f3-568c7b1c85fd req-30281a60-0dda-4fd8-a586-44f91b1d7b56 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031171 Aug 27 01:42:22.797145 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 690/1320] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:42:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:43:03.856085 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-0dad100f-15c1-43b2-9ed6-247d9f6de569 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:43:03.856635 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-0dad100f-15c1-43b2-9ed6-247d9f6de569 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:43:03.862946 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0dad100f-15c1-43b2-9ed6-247d9f6de569 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:43:03.863470 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0dad100f-15c1-43b2-9ed6-247d9f6de569 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:43:03.865087 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0dad100f-15c1-43b2-9ed6-247d9f6de569 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:43:03.865595 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-0dad100f-15c1-43b2-9ed6-247d9f6de569 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:43:03.891692 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-0dad100f-15c1-43b2-9ed6-247d9f6de569 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Going to try to terminate instance {{(pid=108756) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 01:43:03.972732 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-9abf5517-3ff3-457b-b4b8-5b40ea3dbc8e req-fbd66ce0-c0ea-41d6-9492-8967e4a9b670 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b043518-6eef-4325-8de3-ed41b0cafbd3", "tag": "66ae3a5c-bed1-480a-8aa0-cda45f03b919"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:43:03.975249 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:43:03.975249 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:43:03.982616 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-9abf5517-3ff3-457b-b4b8-5b40ea3dbc8e req-fbd66ce0-c0ea-41d6-9492-8967e4a9b670 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:43:03.983291 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-9abf5517-3ff3-457b-b4b8-5b40ea3dbc8e req-fbd66ce0-c0ea-41d6-9492-8967e4a9b670 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:43:03.996663 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-9abf5517-3ff3-457b-b4b8-5b40ea3dbc8e req-fbd66ce0-c0ea-41d6-9492-8967e4a9b670 service nova] Creating event network-changed:66ae3a5c-bed1-480a-8aa0-cda45f03b919 for instance 9b043518-6eef-4325-8de3-ed41b0cafbd3 on hv-cinder-75916 Aug 27 01:43:04.002096 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-9abf5517-3ff3-457b-b4b8-5b40ea3dbc8e req-fbd66ce0-c0ea-41d6-9492-8967e4a9b670 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140803 Aug 27 01:43:04.002726 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 691/1321] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:43:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:43:04.225687 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-0dad100f-15c1-43b2-9ed6-247d9f6de569 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 204 len: 0 microversion: 2.1 time: 0.372906 Aug 27 01:43:04.226426 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 631/1322] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Aug 27 01:43:03 2021] DELETE /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 01:43:04.235087 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-52e33a9b-8ea3-4a95-a8b7-f3a787e44ecd tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:43:04.236049 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-52e33a9b-8ea3-4a95-a8b7-f3a787e44ecd tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:43:04.243056 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-52e33a9b-8ea3-4a95-a8b7-f3a787e44ecd tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:43:04.243496 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-52e33a9b-8ea3-4a95-a8b7-f3a787e44ecd tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:43:04.244291 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-52e33a9b-8ea3-4a95-a8b7-f3a787e44ecd tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:43:04.244734 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-52e33a9b-8ea3-4a95-a8b7-f3a787e44ecd tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:43:04.422395 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-52e33a9b-8ea3-4a95-a8b7-f3a787e44ecd tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:43:04.431045 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-52e33a9b-8ea3-4a95-a8b7-f3a787e44ecd tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1571 microversion: 2.1 time: 0.200122 Aug 27 01:43:04.431689 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 692/1323] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:43:04 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1571 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:43:05.448692 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-23e82e12-c0d2-4f9e-8393-f3d68e4d294a tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:43:05.449405 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-23e82e12-c0d2-4f9e-8393-f3d68e4d294a tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:43:05.455279 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-23e82e12-c0d2-4f9e-8393-f3d68e4d294a tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:43:05.455720 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-23e82e12-c0d2-4f9e-8393-f3d68e4d294a tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:43:05.456472 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-23e82e12-c0d2-4f9e-8393-f3d68e4d294a tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:43:05.456926 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-23e82e12-c0d2-4f9e-8393-f3d68e4d294a tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:43:05.577152 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-23e82e12-c0d2-4f9e-8393-f3d68e4d294a tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:43:05.585297 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-23e82e12-c0d2-4f9e-8393-f3d68e4d294a tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1452 microversion: 2.1 time: 0.140524 Aug 27 01:43:05.585869 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 632/1324] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:43:05 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1452 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:43:06.585303 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-fd13cf6d-4332-4df9-9a9f-775121da1233 req-990ac42b-0328-4aee-89dc-891e7915dff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b043518-6eef-4325-8de3-ed41b0cafbd3", "name": "network-vif-deleted", "tag": "66ae3a5c-bed1-480a-8aa0-cda45f03b919"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:43:06.586853 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:43:06.586853 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:43:06.593683 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-fd13cf6d-4332-4df9-9a9f-775121da1233 req-990ac42b-0328-4aee-89dc-891e7915dff8 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:43:06.594114 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-fd13cf6d-4332-4df9-9a9f-775121da1233 req-990ac42b-0328-4aee-89dc-891e7915dff8 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:43:06.602556 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-ed9d82ae-a918-41bc-85f6-f1cd4eb09f5e tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:43:06.603155 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-ed9d82ae-a918-41bc-85f6-f1cd4eb09f5e tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:43:06.605918 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-fd13cf6d-4332-4df9-9a9f-775121da1233 req-990ac42b-0328-4aee-89dc-891e7915dff8 service nova] Creating event network-vif-deleted:66ae3a5c-bed1-480a-8aa0-cda45f03b919 for instance 9b043518-6eef-4325-8de3-ed41b0cafbd3 on hv-cinder-75916 Aug 27 01:43:06.609366 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ed9d82ae-a918-41bc-85f6-f1cd4eb09f5e tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:43:06.609819 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ed9d82ae-a918-41bc-85f6-f1cd4eb09f5e tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:43:06.610635 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ed9d82ae-a918-41bc-85f6-f1cd4eb09f5e tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:43:06.611061 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-ed9d82ae-a918-41bc-85f6-f1cd4eb09f5e tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:43:06.611181 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-fd13cf6d-4332-4df9-9a9f-775121da1233 req-990ac42b-0328-4aee-89dc-891e7915dff8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029847 Aug 27 01:43:06.611664 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 693/1325] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:43:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:43:06.674513 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-ed9d82ae-a918-41bc-85f6-f1cd4eb09f5e tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:43:06.682332 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-ed9d82ae-a918-41bc-85f6-f1cd4eb09f5e tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1384 microversion: 2.1 time: 0.083332 Aug 27 01:43:06.682887 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 633/1326] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:43:06 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1384 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 01:43:07.698670 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-7114134e-41d0-45c5-8c59-897f9708d5a2 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:43:07.699366 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-7114134e-41d0-45c5-8c59-897f9708d5a2 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:43:07.705503 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7114134e-41d0-45c5-8c59-897f9708d5a2 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:43:07.705939 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7114134e-41d0-45c5-8c59-897f9708d5a2 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:43:07.706702 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7114134e-41d0-45c5-8c59-897f9708d5a2 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:43:07.707141 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7114134e-41d0-45c5-8c59-897f9708d5a2 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:43:07.738506 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7114134e-41d0-45c5-8c59-897f9708d5a2 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:43:07.738969 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-7114134e-41d0-45c5-8c59-897f9708d5a2 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:43:07.740087 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.objects.instance [None req-7114134e-41d0-45c5-8c59-897f9708d5a2 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lazy-loading 'fault' on Instance uuid 9b043518-6eef-4325-8de3-ed41b0cafbd3 {{(pid=108755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:43:07.779423 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-7114134e-41d0-45c5-8c59-897f9708d5a2 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded8a106d4d64603a7c87306eae430b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd683ea4300b545fda6f56b5c11ee189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:43:07.787598 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-7114134e-41d0-45c5-8c59-897f9708d5a2 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 200 len: 1225 microversion: 2.1 time: 0.092833 Aug 27 01:43:07.788172 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 694/1327] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:43:07 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:43:08.805976 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-e820669e-a5d5-4598-af5f-e74e56a9b151 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:43:08.806497 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-e820669e-a5d5-4598-af5f-e74e56a9b151 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] [instance: 9b043518-6eef-4325-8de3-ed41b0cafbd3] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:43:08.812500 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e820669e-a5d5-4598-af5f-e74e56a9b151 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:43:08.819031 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e820669e-a5d5-4598-af5f-e74e56a9b151 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:43:08.819031 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e820669e-a5d5-4598-af5f-e74e56a9b151 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:43:08.819031 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-e820669e-a5d5-4598-af5f-e74e56a9b151 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:43:08.827504 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.wsgi [None req-e820669e-a5d5-4598-af5f-e74e56a9b151 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] HTTP exception thrown: Instance 9b043518-6eef-4325-8de3-ed41b0cafbd3 could not be found. Aug 27 01:43:08.828101 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-e820669e-a5d5-4598-af5f-e74e56a9b151 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Returning 404 to user: Instance 9b043518-6eef-4325-8de3-ed41b0cafbd3 could not be found. {{(pid=108756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:43:08.828961 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-e820669e-a5d5-4598-af5f-e74e56a9b151 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3" status: 404 len: 111 microversion: 2.1 time: 0.027438 Aug 27 01:43:08.829489 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 634/1328] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:43:08 2021] GET /compute/v2.1/servers/9b043518-6eef-4325-8de3-ed41b0cafbd3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:43:09.044976 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-e8ba8862-760b-4526-82c3-386583719224 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] Calling method '.version_select at 0x7ff21412a310>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:43:09.140325 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-e8ba8862-760b-4526-82c3-386583719224 tempest-TestShelveInstance-833845768 tempest-TestShelveInstance-833845768-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1454714052" status: 202 len: 0 microversion: 2.1 time: 0.099243 Aug 27 01:43:09.140928 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 695/1329] 10.222.0.25 () {58 vars in 1254 bytes} [Fri Aug 27 01:43:09 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1454714052 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 01:43:38.580032 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 01:43:38.580601 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: Fri Aug 27 01:43:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 01:43:57.499105 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-cf5796d7-c534-4f29-831c-1b9dc669c35c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-141913849", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1188750384", "security_groups": [{"name": "tempest-secgroup-smoke-1562836854"}], "block_device_mapping_v2": [{"uuid": "191767a2-7b52-4854-8955-4f88caf46d5c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "36f8a83c-fcee-45f1-9a2d-3d2de8a9383c"}]}} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:43:57.600861 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.network.neutron [None req-cf5796d7-c534-4f29-831c-1b9dc669c35c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] validate_networks() for [('36f8a83c-fcee-45f1-9a2d-3d2de8a9383c', None, None, None, None, None)] {{(pid=108756) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 01:43:57.964078 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-cf5796d7-c534-4f29-831c-1b9dc669c35c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Flavor limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 01:43:57.964499 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-cf5796d7-c534-4f29-831c-1b9dc669c35c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Image limits 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 01:43:57.965008 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-cf5796d7-c534-4f29-831c-1b9dc669c35c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Flavor pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 01:43:57.965415 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-cf5796d7-c534-4f29-831c-1b9dc669c35c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Image pref 0:0:0 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 01:43:57.965825 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.virt.hardware [None req-cf5796d7-c534-4f29-831c-1b9dc669c35c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108756) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 01:43:57.974771 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cf5796d7-c534-4f29-831c-1b9dc669c35c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:43:57.975221 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cf5796d7-c534-4f29-831c-1b9dc669c35c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:43:57.976017 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cf5796d7-c534-4f29-831c-1b9dc669c35c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:43:57.976451 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cf5796d7-c534-4f29-831c-1b9dc669c35c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:43:57.992945 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-cf5796d7-c534-4f29-831c-1b9dc669c35c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Getting quotas for project e450a8d39c6c4bc1aa95f2240bf96927. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 01:43:57.996800 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.quota [None req-cf5796d7-c534-4f29-831c-1b9dc669c35c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Getting quotas for user a6b922afb576470db214cfe37258a289 and project e450a8d39c6c4bc1aa95f2240bf96927. Resources: {'ram', 'instances', 'cores'} {{(pid=108756) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 01:43:58.057185 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-cf5796d7-c534-4f29-831c-1b9dc669c35c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Going to run 1 instances... {{(pid=108756) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 01:43:58.059266 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-cf5796d7-c534-4f29-831c-1b9dc669c35c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: d6d3dc24-cb1c-4ef7-8835-ddde174d5c50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='191767a2-7b52-4854-8955-4f88caf46d5c',volume_size=None,volume_type=None)] {{(pid=108756) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 01:43:58.568412 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-cf5796d7-c534-4f29-831c-1b9dc669c35c tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.072771 Aug 27 01:43:58.569408 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 635/1330] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Aug 27 01:43:57 2021] POST /compute/v2.1/servers => generated 406 bytes in 1074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 01:43:58.579192 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-ee359823-b8e1-4eb6-8277-a7dfc75579be tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:43:58.582869 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-ee359823-b8e1-4eb6-8277-a7dfc75579be tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: d6d3dc24-cb1c-4ef7-8835-ddde174d5c50] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:43:58.633134 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-ee359823-b8e1-4eb6-8277-a7dfc75579be tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:43:58.639499 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-ee359823-b8e1-4eb6-8277-a7dfc75579be tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50" status: 200 len: 1094 microversion: 2.1 time: 0.064237 Aug 27 01:43:58.640283 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 696/1331] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:43:58 2021] GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:43:59.656250 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-34c7a9d5-a091-495f-bee3-f9491dfcdf71 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:43:59.657076 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-34c7a9d5-a091-495f-bee3-f9491dfcdf71 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: d6d3dc24-cb1c-4ef7-8835-ddde174d5c50] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:43:59.663711 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-34c7a9d5-a091-495f-bee3-f9491dfcdf71 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:43:59.664207 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-34c7a9d5-a091-495f-bee3-f9491dfcdf71 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:43:59.665013 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-34c7a9d5-a091-495f-bee3-f9491dfcdf71 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:43:59.665453 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-34c7a9d5-a091-495f-bee3-f9491dfcdf71 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:43:59.725275 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-34c7a9d5-a091-495f-bee3-f9491dfcdf71 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:43:59.732733 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-34c7a9d5-a091-495f-bee3-f9491dfcdf71 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50" status: 200 len: 1136 microversion: 2.1 time: 0.080158 Aug 27 01:43:59.733323 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 636/1332] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:43:59 2021] GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 => generated 1136 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:44:00.749577 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-ca039535-ef4c-4536-9c8b-7377be9d5bdc tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:44:00.750188 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-ca039535-ef4c-4536-9c8b-7377be9d5bdc tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: d6d3dc24-cb1c-4ef7-8835-ddde174d5c50] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:44:00.758257 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ca039535-ef4c-4536-9c8b-7377be9d5bdc tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:00.758796 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ca039535-ef4c-4536-9c8b-7377be9d5bdc tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:00.759571 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ca039535-ef4c-4536-9c8b-7377be9d5bdc tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:00.760008 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-ca039535-ef4c-4536-9c8b-7377be9d5bdc tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:00.856399 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-ca039535-ef4c-4536-9c8b-7377be9d5bdc tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:44:00.863864 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-ca039535-ef4c-4536-9c8b-7377be9d5bdc tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50" status: 200 len: 1200 microversion: 2.1 time: 0.117922 Aug 27 01:44:00.864875 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 697/1333] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:44:00 2021] GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 => generated 1200 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:44:01.882093 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-64aeef75-217a-43a2-bff0-5fc064b885fb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:44:01.882699 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-64aeef75-217a-43a2-bff0-5fc064b885fb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: d6d3dc24-cb1c-4ef7-8835-ddde174d5c50] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:44:01.888536 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-64aeef75-217a-43a2-bff0-5fc064b885fb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:01.889015 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-64aeef75-217a-43a2-bff0-5fc064b885fb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:01.890142 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-64aeef75-217a-43a2-bff0-5fc064b885fb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:01.894063 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-64aeef75-217a-43a2-bff0-5fc064b885fb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:02.016641 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-64aeef75-217a-43a2-bff0-5fc064b885fb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:44:02.024625 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-64aeef75-217a-43a2-bff0-5fc064b885fb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50" status: 200 len: 1278 microversion: 2.1 time: 0.146756 Aug 27 01:44:02.025216 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 637/1334] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:44:01 2021] GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 => generated 1278 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:44:02.362094 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-ad7abbd8-2047-46c3-a81a-83e52123da34 req-4edb03f0-8645-44a9-91fd-2335dc4cc8a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6d3dc24-cb1c-4ef7-8835-ddde174d5c50", "tag": "986f58eb-554b-44ff-8734-2002bd04a225"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:44:02.367450 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:44:02.367450 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:44:02.374961 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-ad7abbd8-2047-46c3-a81a-83e52123da34 req-4edb03f0-8645-44a9-91fd-2335dc4cc8a5 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:02.375417 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-ad7abbd8-2047-46c3-a81a-83e52123da34 req-4edb03f0-8645-44a9-91fd-2335dc4cc8a5 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:02.387307 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-ad7abbd8-2047-46c3-a81a-83e52123da34 req-4edb03f0-8645-44a9-91fd-2335dc4cc8a5 service nova] Creating event network-changed:986f58eb-554b-44ff-8734-2002bd04a225 for instance d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 on hv-cinder-75916 Aug 27 01:44:02.392799 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-ad7abbd8-2047-46c3-a81a-83e52123da34 req-4edb03f0-8645-44a9-91fd-2335dc4cc8a5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034167 Aug 27 01:44:02.393950 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 698/1335] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:44:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:44:03.042079 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-b804ca9f-b4e5-44eb-9a93-531d756d7e66 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:44:03.042950 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-b804ca9f-b4e5-44eb-9a93-531d756d7e66 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: d6d3dc24-cb1c-4ef7-8835-ddde174d5c50] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:44:03.048639 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b804ca9f-b4e5-44eb-9a93-531d756d7e66 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:03.049112 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b804ca9f-b4e5-44eb-9a93-531d756d7e66 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:03.049868 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b804ca9f-b4e5-44eb-9a93-531d756d7e66 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:03.050294 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b804ca9f-b4e5-44eb-9a93-531d756d7e66 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:03.172534 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-b804ca9f-b4e5-44eb-9a93-531d756d7e66 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:44:03.180663 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-b804ca9f-b4e5-44eb-9a93-531d756d7e66 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50" status: 200 len: 1266 microversion: 2.1 time: 0.142533 Aug 27 01:44:03.181239 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 638/1336] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:44:03 2021] GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:44:04.198269 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-bbcbf724-29d6-485e-835b-084d6d852d09 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:44:04.198949 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-bbcbf724-29d6-485e-835b-084d6d852d09 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: d6d3dc24-cb1c-4ef7-8835-ddde174d5c50] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:44:04.204942 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bbcbf724-29d6-485e-835b-084d6d852d09 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:04.205383 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bbcbf724-29d6-485e-835b-084d6d852d09 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:04.206136 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bbcbf724-29d6-485e-835b-084d6d852d09 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:04.206564 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-bbcbf724-29d6-485e-835b-084d6d852d09 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:04.327465 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-bbcbf724-29d6-485e-835b-084d6d852d09 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:44:04.334642 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-bbcbf724-29d6-485e-835b-084d6d852d09 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50" status: 200 len: 1266 microversion: 2.1 time: 0.140363 Aug 27 01:44:04.335193 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 699/1337] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:44:04 2021] GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:44:05.351824 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-01908bec-fba6-4a2e-b72f-ab015b477fb4 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:44:05.352440 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-01908bec-fba6-4a2e-b72f-ab015b477fb4 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: d6d3dc24-cb1c-4ef7-8835-ddde174d5c50] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:44:05.358472 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-01908bec-fba6-4a2e-b72f-ab015b477fb4 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:05.358927 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-01908bec-fba6-4a2e-b72f-ab015b477fb4 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:05.359697 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-01908bec-fba6-4a2e-b72f-ab015b477fb4 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:05.360138 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-01908bec-fba6-4a2e-b72f-ab015b477fb4 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:05.477875 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-01908bec-fba6-4a2e-b72f-ab015b477fb4 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:44:05.485219 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-01908bec-fba6-4a2e-b72f-ab015b477fb4 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50" status: 200 len: 1266 microversion: 2.1 time: 0.137828 Aug 27 01:44:05.485773 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 639/1338] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:44:05 2021] GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:44:06.500825 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-f3d8c852-fc78-4e0b-9753-ed49f71494ba tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:44:06.501468 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-f3d8c852-fc78-4e0b-9753-ed49f71494ba tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: d6d3dc24-cb1c-4ef7-8835-ddde174d5c50] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:44:06.507393 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f3d8c852-fc78-4e0b-9753-ed49f71494ba tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:06.507841 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f3d8c852-fc78-4e0b-9753-ed49f71494ba tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:06.508601 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f3d8c852-fc78-4e0b-9753-ed49f71494ba tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:06.509063 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-f3d8c852-fc78-4e0b-9753-ed49f71494ba tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:06.629426 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-f3d8c852-fc78-4e0b-9753-ed49f71494ba tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:44:06.636925 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-f3d8c852-fc78-4e0b-9753-ed49f71494ba tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50" status: 200 len: 1266 microversion: 2.1 time: 0.139634 Aug 27 01:44:06.637489 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 700/1339] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:44:06 2021] GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:44:07.653334 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-d3012ce5-220b-48fd-97a9-c521196f77bb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:44:07.653952 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-d3012ce5-220b-48fd-97a9-c521196f77bb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: d6d3dc24-cb1c-4ef7-8835-ddde174d5c50] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:44:07.659699 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d3012ce5-220b-48fd-97a9-c521196f77bb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:07.660144 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d3012ce5-220b-48fd-97a9-c521196f77bb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:07.660954 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d3012ce5-220b-48fd-97a9-c521196f77bb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:07.661393 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d3012ce5-220b-48fd-97a9-c521196f77bb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:07.779734 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-d3012ce5-220b-48fd-97a9-c521196f77bb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:44:07.787479 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-d3012ce5-220b-48fd-97a9-c521196f77bb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50" status: 200 len: 1266 microversion: 2.1 time: 0.137404 Aug 27 01:44:07.788031 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 640/1340] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:44:07 2021] GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:44:08.804703 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-76cf6a9d-8726-44c6-b044-2acefb76cfda tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:44:08.805312 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-76cf6a9d-8726-44c6-b044-2acefb76cfda tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: d6d3dc24-cb1c-4ef7-8835-ddde174d5c50] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:44:08.811043 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-76cf6a9d-8726-44c6-b044-2acefb76cfda tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:08.811480 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-76cf6a9d-8726-44c6-b044-2acefb76cfda tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:08.812230 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-76cf6a9d-8726-44c6-b044-2acefb76cfda tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:08.812654 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-76cf6a9d-8726-44c6-b044-2acefb76cfda tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:08.935429 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-76cf6a9d-8726-44c6-b044-2acefb76cfda tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:44:08.942518 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-76cf6a9d-8726-44c6-b044-2acefb76cfda tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50" status: 200 len: 1266 microversion: 2.1 time: 0.142222 Aug 27 01:44:08.943674 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 701/1341] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:44:08 2021] GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:44:09.959223 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-d58160a2-5093-4eb0-82fd-529004d88c9e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:44:09.959841 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-d58160a2-5093-4eb0-82fd-529004d88c9e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: d6d3dc24-cb1c-4ef7-8835-ddde174d5c50] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:44:09.965789 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d58160a2-5093-4eb0-82fd-529004d88c9e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:09.966254 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d58160a2-5093-4eb0-82fd-529004d88c9e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:09.967021 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d58160a2-5093-4eb0-82fd-529004d88c9e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:09.967449 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-d58160a2-5093-4eb0-82fd-529004d88c9e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:10.092131 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-d58160a2-5093-4eb0-82fd-529004d88c9e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:44:10.100045 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-d58160a2-5093-4eb0-82fd-529004d88c9e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50" status: 200 len: 1266 microversion: 2.1 time: 0.143804 Aug 27 01:44:10.100699 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 641/1342] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:44:09 2021] GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:44:11.117941 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-16b3c4d2-b2f2-48e0-bc90-ae7bc25736dc tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:44:11.118489 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-16b3c4d2-b2f2-48e0-bc90-ae7bc25736dc tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: d6d3dc24-cb1c-4ef7-8835-ddde174d5c50] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:44:11.124176 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-16b3c4d2-b2f2-48e0-bc90-ae7bc25736dc tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:11.124615 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-16b3c4d2-b2f2-48e0-bc90-ae7bc25736dc tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:11.125393 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-16b3c4d2-b2f2-48e0-bc90-ae7bc25736dc tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:11.125821 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-16b3c4d2-b2f2-48e0-bc90-ae7bc25736dc tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:11.243519 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-16b3c4d2-b2f2-48e0-bc90-ae7bc25736dc tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:44:11.250606 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-16b3c4d2-b2f2-48e0-bc90-ae7bc25736dc tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50" status: 200 len: 1266 microversion: 2.1 time: 0.137739 Aug 27 01:44:11.251150 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 702/1343] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:44:11 2021] GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:44:12.267512 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-812f79d9-5c94-4e39-8721-c5e90d4c111b tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:44:12.268129 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-812f79d9-5c94-4e39-8721-c5e90d4c111b tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: d6d3dc24-cb1c-4ef7-8835-ddde174d5c50] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:44:12.274176 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-812f79d9-5c94-4e39-8721-c5e90d4c111b tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:12.274623 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-812f79d9-5c94-4e39-8721-c5e90d4c111b tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:12.275394 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-812f79d9-5c94-4e39-8721-c5e90d4c111b tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:12.275828 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-812f79d9-5c94-4e39-8721-c5e90d4c111b tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:12.395256 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-812f79d9-5c94-4e39-8721-c5e90d4c111b tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:44:12.403583 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-812f79d9-5c94-4e39-8721-c5e90d4c111b tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50" status: 200 len: 1266 microversion: 2.1 time: 0.139844 Aug 27 01:44:12.404343 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 642/1344] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:44:12 2021] GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:44:12.470026 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-ce0f61f4-7294-480b-94b1-8e20c7a1c340 req-790966b3-9f78-4b3b-9ce4-6d74f3610e65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d3dc24-cb1c-4ef7-8835-ddde174d5c50", "name": "network-vif-plugged", "status": "completed", "tag": "986f58eb-554b-44ff-8734-2002bd04a225"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:44:12.471532 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:44:12.471532 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:44:12.478961 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-ce0f61f4-7294-480b-94b1-8e20c7a1c340 req-790966b3-9f78-4b3b-9ce4-6d74f3610e65 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:12.479401 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-ce0f61f4-7294-480b-94b1-8e20c7a1c340 req-790966b3-9f78-4b3b-9ce4-6d74f3610e65 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:12.490698 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-ce0f61f4-7294-480b-94b1-8e20c7a1c340 req-790966b3-9f78-4b3b-9ce4-6d74f3610e65 service nova] Creating event network-vif-plugged:986f58eb-554b-44ff-8734-2002bd04a225 for instance d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 on hv-cinder-75916 Aug 27 01:44:12.495672 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-ce0f61f4-7294-480b-94b1-8e20c7a1c340 req-790966b3-9f78-4b3b-9ce4-6d74f3610e65 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029353 Aug 27 01:44:12.497809 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 703/1345] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:44:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:44:13.420408 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-3808f62f-6906-4336-b12e-4245dd04de2e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:44:13.421065 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-3808f62f-6906-4336-b12e-4245dd04de2e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: d6d3dc24-cb1c-4ef7-8835-ddde174d5c50] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:44:13.426990 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3808f62f-6906-4336-b12e-4245dd04de2e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:13.428152 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3808f62f-6906-4336-b12e-4245dd04de2e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:13.428789 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3808f62f-6906-4336-b12e-4245dd04de2e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:13.429252 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-3808f62f-6906-4336-b12e-4245dd04de2e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:13.547816 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-3808f62f-6906-4336-b12e-4245dd04de2e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:44:13.555574 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-3808f62f-6906-4336-b12e-4245dd04de2e tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50" status: 200 len: 1266 microversion: 2.1 time: 0.139120 Aug 27 01:44:13.556123 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 643/1346] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:44:13 2021] GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:44:14.573325 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-2a55b5eb-ab44-49f6-9554-054ee873c185 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:44:14.574043 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-2a55b5eb-ab44-49f6-9554-054ee873c185 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: d6d3dc24-cb1c-4ef7-8835-ddde174d5c50] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:44:14.580273 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2a55b5eb-ab44-49f6-9554-054ee873c185 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:14.580712 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2a55b5eb-ab44-49f6-9554-054ee873c185 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:14.581492 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2a55b5eb-ab44-49f6-9554-054ee873c185 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:14.581917 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-2a55b5eb-ab44-49f6-9554-054ee873c185 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:14.706213 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-2a55b5eb-ab44-49f6-9554-054ee873c185 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:44:14.714058 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-2a55b5eb-ab44-49f6-9554-054ee873c185 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50" status: 200 len: 1454 microversion: 2.1 time: 0.145170 Aug 27 01:44:14.714605 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 704/1347] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:44:14 2021] GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 => generated 1454 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:44:14.729935 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-b0592c7e-47e9-432d-b459-930db5d927b5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:44:14.730543 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-b0592c7e-47e9-432d-b459-930db5d927b5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: d6d3dc24-cb1c-4ef7-8835-ddde174d5c50] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:44:14.736708 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b0592c7e-47e9-432d-b459-930db5d927b5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:14.737186 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b0592c7e-47e9-432d-b459-930db5d927b5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:14.737950 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b0592c7e-47e9-432d-b459-930db5d927b5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:14.738383 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-b0592c7e-47e9-432d-b459-930db5d927b5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:14.860782 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-b0592c7e-47e9-432d-b459-930db5d927b5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:44:14.868947 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-b0592c7e-47e9-432d-b459-930db5d927b5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50" status: 200 len: 1454 microversion: 2.1 time: 0.142585 Aug 27 01:44:14.869513 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 644/1348] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:44:14 2021] GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 => generated 1454 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:44:17.069381 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49bacde0-f4f7-4401-ad1e-0e21fe9180e8] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 01:44:17.072235 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-880317db-41e9-422b-a9ed-fce1f5302079 req-c227794e-9d15-4a84-8161-42dd43c53fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6d3dc24-cb1c-4ef7-8835-ddde174d5c50", "tag": "986f58eb-554b-44ff-8734-2002bd04a225"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:44:17.073697 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:44:17.073697 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:44:17.080423 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-880317db-41e9-422b-a9ed-fce1f5302079 req-c227794e-9d15-4a84-8161-42dd43c53fb4 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:44:17.080790 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-880317db-41e9-422b-a9ed-fce1f5302079 req-c227794e-9d15-4a84-8161-42dd43c53fb4 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:44:17.091882 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-880317db-41e9-422b-a9ed-fce1f5302079 req-c227794e-9d15-4a84-8161-42dd43c53fb4 service nova] Creating event network-changed:986f58eb-554b-44ff-8734-2002bd04a225 for instance d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 on hv-cinder-75916 Aug 27 01:44:17.097798 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-880317db-41e9-422b-a9ed-fce1f5302079 req-c227794e-9d15-4a84-8161-42dd43c53fb4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034568 Aug 27 01:44:17.098440 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 705/1349] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:44:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:45:34.281608 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 01:45:34.282313 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: Fri Aug 27 01:45:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 01:45:35.111827 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 01:45:35.112367 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: Fri Aug 27 01:45:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 01:45:48.200560 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b9a2838d-0571-43fc-b3f1-3ac37eecd7c4] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 01:45:48.204389 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-9750651d-9237-4310-a52b-0ddcc049b326 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:45:48.205074 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-9750651d-9237-4310-a52b-0ddcc049b326 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: d6d3dc24-cb1c-4ef7-8835-ddde174d5c50] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:45:48.211239 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9750651d-9237-4310-a52b-0ddcc049b326 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:45:48.211677 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9750651d-9237-4310-a52b-0ddcc049b326 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:45:48.212721 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9750651d-9237-4310-a52b-0ddcc049b326 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:45:48.212938 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-9750651d-9237-4310-a52b-0ddcc049b326 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:45:48.216173 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-aee50cca-88cc-42b9-bae1-10a7892bc67b req-0596159f-50d5-46f8-936b-c914f8b78d3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6d3dc24-cb1c-4ef7-8835-ddde174d5c50", "tag": "986f58eb-554b-44ff-8734-2002bd04a225"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:45:48.217739 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:45:48.217739 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:45:48.225446 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-aee50cca-88cc-42b9-bae1-10a7892bc67b req-0596159f-50d5-46f8-936b-c914f8b78d3e service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:45:48.225888 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-aee50cca-88cc-42b9-bae1-10a7892bc67b req-0596159f-50d5-46f8-936b-c914f8b78d3e service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:45:48.238951 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-aee50cca-88cc-42b9-bae1-10a7892bc67b req-0596159f-50d5-46f8-936b-c914f8b78d3e service nova] Creating event network-changed:986f58eb-554b-44ff-8734-2002bd04a225 for instance d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 on hv-cinder-75916 Aug 27 01:45:48.240107 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-9750651d-9237-4310-a52b-0ddcc049b326 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: d6d3dc24-cb1c-4ef7-8835-ddde174d5c50] Going to try to terminate instance {{(pid=108756) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 01:45:48.243956 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-aee50cca-88cc-42b9-bae1-10a7892bc67b req-0596159f-50d5-46f8-936b-c914f8b78d3e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042581 Aug 27 01:45:48.244568 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 706/1350] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:45:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 01:45:48.467665 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-9750651d-9237-4310-a52b-0ddcc049b326 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50" status: 204 len: 0 microversion: 2.1 time: 0.268794 Aug 27 01:45:48.468566 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 645/1351] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Aug 27 01:45:48 2021] DELETE /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 01:45:48.478002 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-1d3e2ab9-3c87-40cc-ae4d-89ddf3da72a4 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:45:48.479120 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-1d3e2ab9-3c87-40cc-ae4d-89ddf3da72a4 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: d6d3dc24-cb1c-4ef7-8835-ddde174d5c50] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:45:48.484893 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO oslo.messaging._drivers.impl_rabbit [-] [49bacde0-f4f7-4401-ad1e-0e21fe9180e8] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 33234. Aug 27 01:45:48.488923 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1d3e2ab9-3c87-40cc-ae4d-89ddf3da72a4 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:45:48.489375 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1d3e2ab9-3c87-40cc-ae4d-89ddf3da72a4 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:45:48.490155 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1d3e2ab9-3c87-40cc-ae4d-89ddf3da72a4 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:45:48.490587 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-1d3e2ab9-3c87-40cc-ae4d-89ddf3da72a4 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:45:48.677331 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-1d3e2ab9-3c87-40cc-ae4d-89ddf3da72a4 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:45:48.685634 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-1d3e2ab9-3c87-40cc-ae4d-89ddf3da72a4 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50" status: 200 len: 1579 microversion: 2.1 time: 0.212750 Aug 27 01:45:48.686417 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 707/1352] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:45:48 2021] GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 => generated 1579 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:45:49.703788 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-c6f9eb9f-ebb4-40f7-b79e-6560ac135906 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:45:49.704404 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-c6f9eb9f-ebb4-40f7-b79e-6560ac135906 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: d6d3dc24-cb1c-4ef7-8835-ddde174d5c50] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:45:49.724239 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c6f9eb9f-ebb4-40f7-b79e-6560ac135906 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:45:49.724685 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c6f9eb9f-ebb4-40f7-b79e-6560ac135906 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:45:49.725495 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c6f9eb9f-ebb4-40f7-b79e-6560ac135906 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:45:49.725923 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-c6f9eb9f-ebb4-40f7-b79e-6560ac135906 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:45:49.732053 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO oslo.messaging._drivers.impl_rabbit [-] [b9a2838d-0571-43fc-b3f1-3ac37eecd7c4] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 33240. Aug 27 01:45:49.850569 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-c6f9eb9f-ebb4-40f7-b79e-6560ac135906 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:45:49.857950 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-c6f9eb9f-ebb4-40f7-b79e-6560ac135906 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50" status: 200 len: 1460 microversion: 2.1 time: 0.158291 Aug 27 01:45:49.858536 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 646/1353] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:45:49 2021] GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 => generated 1460 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:45:50.741105 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [req-97965dd2-e09c-448a-a1eb-c049ff910f5e req-9b937ef2-d290-4c31-883d-9aca6a83b444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d3dc24-cb1c-4ef7-8835-ddde174d5c50", "name": "network-vif-deleted", "tag": "986f58eb-554b-44ff-8734-2002bd04a225"}]} {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:45:50.742776 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:45:50.742776 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: warnings.warn(msg) Aug 27 01:45:50.749588 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-97965dd2-e09c-448a-a1eb-c049ff910f5e req-9b937ef2-d290-4c31-883d-9aca6a83b444 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:45:50.754000 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [req-97965dd2-e09c-448a-a1eb-c049ff910f5e req-9b937ef2-d290-4c31-883d-9aca6a83b444 service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:45:50.761241 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.compute.server_external_events [req-97965dd2-e09c-448a-a1eb-c049ff910f5e req-9b937ef2-d290-4c31-883d-9aca6a83b444 service nova] Creating event network-vif-deleted:986f58eb-554b-44ff-8734-2002bd04a225 for instance d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 on hv-cinder-75916 Aug 27 01:45:50.766382 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [req-97965dd2-e09c-448a-a1eb-c049ff910f5e req-9b937ef2-d290-4c31-883d-9aca6a83b444 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029054 Aug 27 01:45:50.766938 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 708/1354] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:45:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:45:50.874690 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-cc824765-0b1a-4abb-bf67-3a566d6350d0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:45:50.875442 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-cc824765-0b1a-4abb-bf67-3a566d6350d0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: d6d3dc24-cb1c-4ef7-8835-ddde174d5c50] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:45:50.883052 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cc824765-0b1a-4abb-bf67-3a566d6350d0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:45:50.883052 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cc824765-0b1a-4abb-bf67-3a566d6350d0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:45:50.883052 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cc824765-0b1a-4abb-bf67-3a566d6350d0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:45:50.883052 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-cc824765-0b1a-4abb-bf67-3a566d6350d0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:45:50.943853 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-cc824765-0b1a-4abb-bf67-3a566d6350d0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:45:50.951838 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-cc824765-0b1a-4abb-bf67-3a566d6350d0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50" status: 200 len: 1225 microversion: 2.1 time: 0.080940 Aug 27 01:45:50.952395 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 647/1355] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:45:50 2021] GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:45:51.969257 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-5e0d6aac-d610-465c-959d-352c9b422283 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:45:51.969946 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-5e0d6aac-d610-465c-959d-352c9b422283 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: d6d3dc24-cb1c-4ef7-8835-ddde174d5c50] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:45:51.975837 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5e0d6aac-d610-465c-959d-352c9b422283 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:45:51.976285 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5e0d6aac-d610-465c-959d-352c9b422283 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:45:51.977073 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5e0d6aac-d610-465c-959d-352c9b422283 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:45:51.977605 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5e0d6aac-d610-465c-959d-352c9b422283 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:45:52.007867 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5e0d6aac-d610-465c-959d-352c9b422283 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:45:52.008238 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5e0d6aac-d610-465c-959d-352c9b422283 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:45:52.008679 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.objects.instance [None req-5e0d6aac-d610-465c-959d-352c9b422283 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lazy-loading 'fault' on Instance uuid d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 {{(pid=108755) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 01:45:52.048787 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-5e0d6aac-d610-465c-959d-352c9b422283 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:45:52.055476 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-5e0d6aac-d610-465c-959d-352c9b422283 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50" status: 200 len: 1184 microversion: 2.1 time: 0.090518 Aug 27 01:45:52.056035 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 709/1356] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:45:51 2021] GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 => generated 1184 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:45:53.077477 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-fb773f90-2d65-43f9-851e-11d3d00ea2c6 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:45:53.078017 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-fb773f90-2d65-43f9-851e-11d3d00ea2c6 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: d6d3dc24-cb1c-4ef7-8835-ddde174d5c50] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:45:53.083776 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fb773f90-2d65-43f9-851e-11d3d00ea2c6 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:45:53.084225 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fb773f90-2d65-43f9-851e-11d3d00ea2c6 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:45:53.085076 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fb773f90-2d65-43f9-851e-11d3d00ea2c6 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:45:53.085552 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fb773f90-2d65-43f9-851e-11d3d00ea2c6 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:45:53.099290 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.wsgi [None req-fb773f90-2d65-43f9-851e-11d3d00ea2c6 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] HTTP exception thrown: Instance d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 could not be found. Aug 27 01:45:53.099943 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-fb773f90-2d65-43f9-851e-11d3d00ea2c6 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Returning 404 to user: Instance d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 could not be found. {{(pid=108756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:45:53.100765 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-fb773f90-2d65-43f9-851e-11d3d00ea2c6 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50" status: 404 len: 111 microversion: 2.1 time: 0.027820 Aug 27 01:45:53.101415 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 648/1357] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:45:53 2021] GET /compute/v2.1/servers/d6d3dc24-cb1c-4ef7-8835-ddde174d5c50 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:45:56.409104 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-e95f2e02-14ae-4027-866b-86da0206b9d2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:45:56.409741 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-e95f2e02-14ae-4027-866b-86da0206b9d2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: 9a473973-cb03-4335-bad0-618c98df77cd] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:45:56.410131 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-f04498f6-d5f7-4ac6-9bbb-6bdc81bc764e req-cf53e8ae-ee6d-4ab9-a673-cc3882e83a0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a473973-cb03-4335-bad0-618c98df77cd", "tag": "f3304d45-9af7-4da5-8afa-fdd205afecba"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:45:56.411665 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:45:56.411665 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:45:56.416753 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e95f2e02-14ae-4027-866b-86da0206b9d2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:45:56.417320 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e95f2e02-14ae-4027-866b-86da0206b9d2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:45:56.418671 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e95f2e02-14ae-4027-866b-86da0206b9d2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:45:56.418671 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-e95f2e02-14ae-4027-866b-86da0206b9d2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:45:56.421927 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-f04498f6-d5f7-4ac6-9bbb-6bdc81bc764e req-cf53e8ae-ee6d-4ab9-a673-cc3882e83a0e service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:45:56.422366 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-f04498f6-d5f7-4ac6-9bbb-6bdc81bc764e req-cf53e8ae-ee6d-4ab9-a673-cc3882e83a0e service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:45:56.439876 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-f04498f6-d5f7-4ac6-9bbb-6bdc81bc764e req-cf53e8ae-ee6d-4ab9-a673-cc3882e83a0e service nova] Creating event network-changed:f3304d45-9af7-4da5-8afa-fdd205afecba for instance 9a473973-cb03-4335-bad0-618c98df77cd on hv-cinder-75916 Aug 27 01:45:56.447520 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-f04498f6-d5f7-4ac6-9bbb-6bdc81bc764e req-cf53e8ae-ee6d-4ab9-a673-cc3882e83a0e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041592 Aug 27 01:45:56.448309 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 649/1358] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:45:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:45:56.452230 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-e95f2e02-14ae-4027-866b-86da0206b9d2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: 9a473973-cb03-4335-bad0-618c98df77cd] Going to try to terminate instance {{(pid=108755) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 01:45:56.711828 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-e95f2e02-14ae-4027-866b-86da0206b9d2 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd" status: 204 len: 0 microversion: 2.1 time: 0.307372 Aug 27 01:45:56.712432 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 710/1359] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Aug 27 01:45:56 2021] DELETE /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 01:45:56.721474 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-8d625c5c-bf74-4c4c-8694-0ffe5891eec0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:45:56.722182 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-8d625c5c-bf74-4c4c-8694-0ffe5891eec0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: 9a473973-cb03-4335-bad0-618c98df77cd] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:45:56.728755 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8d625c5c-bf74-4c4c-8694-0ffe5891eec0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:45:56.729265 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8d625c5c-bf74-4c4c-8694-0ffe5891eec0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:45:56.730039 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8d625c5c-bf74-4c4c-8694-0ffe5891eec0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:45:56.730472 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-8d625c5c-bf74-4c4c-8694-0ffe5891eec0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:45:56.869538 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.policy [None req-8d625c5c-bf74-4c4c-8694-0ffe5891eec0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108756) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:45:56.880374 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-8d625c5c-bf74-4c4c-8694-0ffe5891eec0 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd" status: 200 len: 1579 microversion: 2.1 time: 0.163081 Aug 27 01:45:56.882043 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 650/1360] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:45:56 2021] GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd => generated 1579 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:45:57.898637 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-0c230c29-83c3-445f-bf3e-b664c7e0cf9f tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:45:57.899324 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-0c230c29-83c3-445f-bf3e-b664c7e0cf9f tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: 9a473973-cb03-4335-bad0-618c98df77cd] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:45:57.905873 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0c230c29-83c3-445f-bf3e-b664c7e0cf9f tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:45:57.906309 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0c230c29-83c3-445f-bf3e-b664c7e0cf9f tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:45:57.907057 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0c230c29-83c3-445f-bf3e-b664c7e0cf9f tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:45:57.907481 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-0c230c29-83c3-445f-bf3e-b664c7e0cf9f tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:45:58.025955 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-0c230c29-83c3-445f-bf3e-b664c7e0cf9f tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:45:58.033463 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-0c230c29-83c3-445f-bf3e-b664c7e0cf9f tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd" status: 200 len: 1461 microversion: 2.1 time: 0.138858 Aug 27 01:45:58.034014 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 711/1361] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:45:57 2021] GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd => generated 1461 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:45:58.907619 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [req-c71c7b90-0f01-4e2f-bd49-0b4e781f2a8a req-2122a97f-0850-456e-99d1-bd40d021c84f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a473973-cb03-4335-bad0-618c98df77cd", "name": "network-vif-deleted", "tag": "f3304d45-9af7-4da5-8afa-fdd205afecba"}]} {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 01:45:58.909305 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 01:45:58.909305 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: warnings.warn(msg) Aug 27 01:45:58.916319 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-c71c7b90-0f01-4e2f-bd49-0b4e781f2a8a req-2122a97f-0850-456e-99d1-bd40d021c84f service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:45:58.916752 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [req-c71c7b90-0f01-4e2f-bd49-0b4e781f2a8a req-2122a97f-0850-456e-99d1-bd40d021c84f service nova] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:45:58.928065 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.compute.server_external_events [req-c71c7b90-0f01-4e2f-bd49-0b4e781f2a8a req-2122a97f-0850-456e-99d1-bd40d021c84f service nova] Creating event network-vif-deleted:f3304d45-9af7-4da5-8afa-fdd205afecba for instance 9a473973-cb03-4335-bad0-618c98df77cd on hv-cinder-75916 Aug 27 01:45:58.933173 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [req-c71c7b90-0f01-4e2f-bd49-0b4e781f2a8a req-2122a97f-0850-456e-99d1-bd40d021c84f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029665 Aug 27 01:45:58.933764 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 651/1362] 10.222.0.25 () {64 vars in 1318 bytes} [Fri Aug 27 01:45:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 01:45:59.050235 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-5cfdc582-d26a-473f-9ada-47b016534b92 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:45:59.050838 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-5cfdc582-d26a-473f-9ada-47b016534b92 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: 9a473973-cb03-4335-bad0-618c98df77cd] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:45:59.056779 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5cfdc582-d26a-473f-9ada-47b016534b92 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:45:59.057301 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5cfdc582-d26a-473f-9ada-47b016534b92 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:45:59.058060 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5cfdc582-d26a-473f-9ada-47b016534b92 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:45:59.058491 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-5cfdc582-d26a-473f-9ada-47b016534b92 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:45:59.124987 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.policy [None req-5cfdc582-d26a-473f-9ada-47b016534b92 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b922afb576470db214cfe37258a289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e450a8d39c6c4bc1aa95f2240bf96927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108755) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 01:45:59.132198 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-5cfdc582-d26a-473f-9ada-47b016534b92 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd" status: 200 len: 1226 microversion: 2.1 time: 0.085640 Aug 27 01:45:59.132746 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 712/1363] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:45:59 2021] GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 01:46:00.149528 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-47627016-0261-4aa0-afe6-370c99da1cea tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:46:00.150138 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-47627016-0261-4aa0-afe6-370c99da1cea tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: 9a473973-cb03-4335-bad0-618c98df77cd] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:46:00.157208 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-47627016-0261-4aa0-afe6-370c99da1cea tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:46:00.157921 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-47627016-0261-4aa0-afe6-370c99da1cea tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:46:00.159170 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-47627016-0261-4aa0-afe6-370c99da1cea tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:46:00.159626 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-47627016-0261-4aa0-afe6-370c99da1cea tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:46:00.176278 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.wsgi [None req-47627016-0261-4aa0-afe6-370c99da1cea tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] HTTP exception thrown: Instance 9a473973-cb03-4335-bad0-618c98df77cd could not be found. Aug 27 01:46:00.176894 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-47627016-0261-4aa0-afe6-370c99da1cea tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Returning 404 to user: Instance 9a473973-cb03-4335-bad0-618c98df77cd could not be found. {{(pid=108756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:46:00.179700 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-47627016-0261-4aa0-afe6-370c99da1cea tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd" status: 404 len: 111 microversion: 2.1 time: 0.032528 Aug 27 01:46:00.179700 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 652/1364] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:46:00 2021] GET /compute/v2.1/servers/9a473973-cb03-4335-bad0-618c98df77cd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:46:00.697430 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-a5ad439f-4bfd-45d0-8d31-a02f5f860feb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:46:00.697959 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.compute.api [None req-a5ad439f-4bfd-45d0-8d31-a02f5f860feb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: b1462288-b9a8-48fe-9593-e9572fd0b7ba] Fetching instance by UUID {{(pid=108755) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:46:00.704461 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a5ad439f-4bfd-45d0-8d31-a02f5f860feb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:46:00.704934 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a5ad439f-4bfd-45d0-8d31-a02f5f860feb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:46:00.705702 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a5ad439f-4bfd-45d0-8d31-a02f5f860feb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:46:00.706133 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG oslo_concurrency.lockutils [None req-a5ad439f-4bfd-45d0-8d31-a02f5f860feb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:46:00.720769 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.wsgi [None req-a5ad439f-4bfd-45d0-8d31-a02f5f860feb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] HTTP exception thrown: Instance b1462288-b9a8-48fe-9593-e9572fd0b7ba could not be found. Aug 27 01:46:00.721373 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-a5ad439f-4bfd-45d0-8d31-a02f5f860feb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Returning 404 to user: Instance b1462288-b9a8-48fe-9593-e9572fd0b7ba could not be found. {{(pid=108755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:46:00.722169 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-a5ad439f-4bfd-45d0-8d31-a02f5f860feb tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba" status: 404 len: 111 microversion: 2.1 time: 0.028463 Aug 27 01:46:00.722674 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 713/1365] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Aug 27 01:46:00 2021] DELETE /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:46:00.730541 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-fbac75e3-9671-4921-ad21-6514240b7db5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '>' {{(pid=108756) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:46:00.731150 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.compute.api [None req-fbac75e3-9671-4921-ad21-6514240b7db5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] [instance: b1462288-b9a8-48fe-9593-e9572fd0b7ba] Fetching instance by UUID {{(pid=108756) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 01:46:00.736990 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fbac75e3-9671-4921-ad21-6514240b7db5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:46:00.737437 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fbac75e3-9671-4921-ad21-6514240b7db5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:46:00.738200 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fbac75e3-9671-4921-ad21-6514240b7db5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 01:46:00.738635 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG oslo_concurrency.lockutils [None req-fbac75e3-9671-4921-ad21-6514240b7db5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Lock "2d291931-575f-426d-9dd3-f69ed6f115bd" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108756) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 01:46:00.751731 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.wsgi [None req-fbac75e3-9671-4921-ad21-6514240b7db5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] HTTP exception thrown: Instance b1462288-b9a8-48fe-9593-e9572fd0b7ba could not be found. Aug 27 01:46:00.752319 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: DEBUG nova.api.openstack.wsgi [None req-fbac75e3-9671-4921-ad21-6514240b7db5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Returning 404 to user: Instance b1462288-b9a8-48fe-9593-e9572fd0b7ba could not be found. {{(pid=108756) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 01:46:00.753154 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO nova.api.openstack.requestlog [None req-fbac75e3-9671-4921-ad21-6514240b7db5 tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba" status: 404 len: 111 microversion: 2.1 time: 0.026399 Aug 27 01:46:00.753961 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: [pid: 108756|app: 0|req: 653/1366] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Aug 27 01:46:00 2021] GET /compute/v2.1/servers/b1462288-b9a8-48fe-9593-e9572fd0b7ba => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 01:46:02.261166 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: DEBUG nova.api.openstack.wsgi [None req-1ef12a88-210e-4c25-b493-5275a5ef351b tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] Calling method '.version_select at 0x7ff214099040>' {{(pid=108755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 01:46:02.331059 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO nova.api.openstack.requestlog [None req-1ef12a88-210e-4c25-b493-5275a5ef351b tempest-TestVolumeBootPattern-886769182 tempest-TestVolumeBootPattern-886769182-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1188750384" status: 202 len: 0 microversion: 2.1 time: 0.073514 Aug 27 01:46:02.331634 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: [pid: 108755|app: 0|req: 714/1367] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Aug 27 01:46:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1188750384 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 01:46:55.023355 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 01:46:55.023977 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: Fri Aug 27 01:46:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 01:46:58.597880 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 01:46:58.598556 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: Fri Aug 27 01:46:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 01:48:54.299396 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 01:48:54.300044 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: Fri Aug 27 01:48:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 01:48:55.129699 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 01:48:55.130308 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: Fri Aug 27 01:48:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 01:49:08.619191 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 01:49:08.619745 dv-cinder-759169-3-iscsi devstack@n-api.service[108755]: Fri Aug 27 01:49:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 01:50:15.041181 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 01:50:15.041853 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: Fri Aug 27 01:50:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 01:50:18.615615 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 01:50:18.616354 dv-cinder-759169-3-iscsi devstack@n-api.service[108756]: Fri Aug 27 01:50:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!